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Preface 

The  purpose  of  this  study  was  to  perform  a  comparison  between  the  Navy 
Statistical  Demand  Forecasting  system  and  the  Air  Force  Requirements  Data  Bank 
forecasting  system.  The  results  of  this  research  may  help  the  Air  Force  managers  and  the 
Joint  Logistics  System  Center  managers  to  obtain  a  better  understanding  of  the 
implications  in  using  one  system  versus  the  other. 

An  extensive  search  of  existing  literature  was  conducted  to  gain  an  understanding 
of  the  basic  algorithms  of  each  system.  A  simulation  model  of  the  Requirements  Data 
Bank  system  was  developed  to  generate  Air  Force  forecasts.  The  actual  Statistical 
Demand  Forecasting  system  was  used  to  generate  Navy  forecasts. 
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Abstract 

In  Murcn  1993,  the  JLSC  selected  the  Navy's  Statistical  Demand  Furecasting 
System  as  the  standard  DOD  forecasting  system.  The  purpose  of  this  study  was  to 
evaluate  and  compare  the  performance  and  accuracy  of  the  Navy  Statistical  Demand 
Forecasting  system,  relative  to  the  Air  Force  Requirements  Data  Bank  forecasting  system 
in  an  Air  Force  environment.  To  compare  the  performance  of  each  forecasting  system,  the 
research  used  three  different  approaches. 

The  first  approach  looked  at  time  series  components  and  evaluated  how  each 
forecasting  system  reacted  to  different  data  patterns.  From  this  approach,  it  was  found 
that  under  the  presence  of  a  trending  component,  the  Statistical  Demand  Forecasting 
system  generated  more  accurate  foreca,sts  than  the  Requirements  Data  Bank  system  did. 

It  was  also  found  that  under  the  presence  of  outliers,  the  SDF  system  computed  more 
accurate  forecasts  than  the  RDB  system  did. 

The  second  approach  looked  at  the  actual  Air  Force  data  and  evaluated  the 
forecast  accuracy  established  by  each  forecasting  technique.  The  results  demonstrated 
that  there  was  no  significant  difference  in  the  forecast  accuracy  between  the  two 
forecasting  systems. 

The  third  approach  looked  at  how  each  foreca.sting  system  wtiuld  affect  aircraft 
availability.  It  was  found  that  under  the  presence  of  trending  data  and  outliers,  there  was  a 
significant  difference  in  aircraft  availability  between  the  two  forecasting  systems. 

However  it  was  found  that  under  the  presence  of  actual  Air  Force  data,  there  was  no 
significant  difference  in  aircraft  availability  between  the  two  forecasting  systems 

Contrary  to  the  RDB  sy.stem,  the  SDF  .system  performs  well  in  detecting  outliers 
and  trending  component  data.  However  it  was  found  that  with  actual  Air  Force  data,  the 
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SDF  system  and  the  RDB  system  generate  forecasts  with  approximately  the  same  level  of 
aircraft  availability.  These  results  demonstrate  that  either  system  represents  a  good 
approach  to  generate  forecasts  that  will  provide  relatively  the  same  level  of  aircraft 
availability. 


EVALUATION  OF  AIR  FORCE 
AND  NAVY  DEMAND  FORECASTING  SYSTEMS 
L  Introduction 

General  Issue 

The  military  services  use  large  inventory  systems  to  manage  many  items  of  varying 
attributes  or  characteristics.  Forecasting  demand  for  and  acquiring  spare  parts  is  an 
important  facet  of  inventory  systems. 

Although  results  obtained  from  different  forecasting  methods  may  vary  slightly,  a 
one  percent  difference  can  represent  millions  of  dollars  of  investment  (Roberts,  1991:4). 
Over  70  percent  of  the  Air  Force's  computed  gross  requirement  for  reparable  spares  is 
computed  by  forecasting  the  expected  number  of  component  failures.  Because  of  the  size 
of  the  computed  demand-based  gross  requirement  ($43  billion  in  procurement  and  $4 
billion  in  repair),  a  small  percentage  error  in  forecasted  demands  can  translate  into  a  large 
dollar  amount  (Bachman,  1993;  1).  It  is  important  to  ensure  that  the  forecasting  method 
selected  is  the  most  appropriate  and  accurate,  because  overestimated  demands  will  cause 
the  requirements  system  to  drive  unnecessary  buys  and  repairs,  while  items  with 
underestimated  demands  will  cause  backorders  which  translate  into  bad  supply 
performance  (Bachman,  1993:3). 

BaclsgfQUhd 

A  logistics  management  information  system  consists  of  an  extensive  network  of 
interrelated  sub-systems  which  manages  the  procurement,  distribution,  repair  and 
maintenance  of  spare  parts  to  support  weapon  systems  (Bond,  1989: 1).  For  many  years, 
the  Air  Force,  the  Army,  the  Navy  and  the  Defense  Logistics  Agency  have  each  spent 
millions  of  dollars  to  design,  develop  and  maintain  logistics  systems.  Although  each 
service  has  its  own  specific  logistics  system,  the  objectives  of  each  .system  remain  the 
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same.  For  this  reason,  the  Department  of  Defense  gathered  that  it  would  be  more  cost 
effective  to  maintain  one  standard  DOD  logistics  system  than  to  maintain  four.  On 
February  13,  1992,  the  Assistant  Secretary  of  Defense  approved  the  charter  for  the  Joint 
Logistic  System  Center  (JLSC)  (Klugh,  1994a). 

The  JLSC  has  been  tasked  with  the  highly  complex  and  complicated  mission  of 
developing  and  implementing  standard  materiel  management  and  depot  maintenance 
automated  business  systems  across  the  Department  of  Defense  (DOD)  (Klugh,  1994b). 
The  JLSC's  main  mission  is  to  evaluate  and  select  the  sub-systems  from  each  service’s 
logistics  system  to  produce  a  standard  DOD  logistic  system  most  appropriate  to  the  Air 
Force,  Navy,  Army,  and  DLA  (Defense  Logistics  Agency)  (Klugh,  1994b).  The  difficulty 
lies  in  determining  which  sub-systems  DOD  should  keep  for  all  four  organizations, 
especially  when  each  service  has  developed  different  approaches  for  similar  sub-systems. 
Figure  1-1  illustrates  the  integration  of  the  sub-systems  into  a  standard  DOD  Logistic 
System. 


Figure  1-1.  Joint  Logistic  Systems 


One  of  the  elements  studied  by  the  JLSC  is  the  sub-system  which  forecasts  demand 
for  reparable  spare  parts.  This  sub-system  determines  the  worldwide  requirements  for 
reparable  spare  parts  to  satisfy  future  operational  goals  for  weapon  systems.  In  November 


1992,  the  JLSC  approved  the  Statistical  Demand  Forecasting  System  (SDF)  as  a  neai-  term 
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initiative  to  be  implemented  at  the  Defense  Logistics  Agency  Inventory  Control  Points 
(Moore,  1994).  In  March  1993,  the  JLSC  selected  the  Navy's  Statistical  Demand 
Forecasting  System  as  the  standard  DOD  forecasting  system  (Moore,  1994). 

Another  element  studied  by  the  JLSC  is  the  database  sub-system  which  maintains 
data  on  consumable  and  recoverable  items.  The  JLSC  selected  the  Air  Force's 
Requirements  Data  Bank  (RDB)  information  system  as  the  database  sub-system  for  the 
standard  DOD  Logistics  System  (Moore,  1994).  Along  with  its  database  capacity,  the 
Requirements  Data  Bank  information  system  also  contains  various  materiel  management 
processes  and  functions  used  to  manage  the  Air  Force  inventory  (Searock,  1992:Ch  1,  2). 
One  of  the  processes  or  sub-systems  of  RDB  used  to  compute  recoverable  items' 
requirements  is  the  Recoverable  Item  Process.  The  Recoverable  Item  Process  implicitly 
contains  an  integrated  forecasting  approach.  Since  the  RDB  information  system  has 
already  incorporated  an  integrated  forecasting  approach,  the  Air  Force  Material  Command 
is  questioning  the  adoption  of  the  Navy's  Statistical  Demand  Forecasting  System  (Gitman, 
1994). 

The  JLSC  recently  decided  to  temporarily  keep  the  RDB  forecasti'  component 
for  the  Air  Force  (Moore,  1994).  The  decision  to  allow  the  Air  Force  to  use  its  RDB 
forecasting  approach  is  implicitly  contained  in  the  JLSC  Requirements  Determination 
Business  Process  Model  (Moore,  1994). 

Specific  Problem 

Since  the  JLSC  selected  the  Navy's  Statistical  Demand  Forecasting  System  as  the 
standard  DOD  forecasting  .sy.stem,  the  Army  and  the  Defense  Logistics  Agency  have  both 
performed  analyses  to  measure  the  impact  of  using  SDF  within  their  own  organization 
(Wehde,  1994b;  Roberts,  1994).  The  specific  problem  is  that  the  Air  Force  has  not 
analyzed  or  studied  how  SDF  could  affect  its  operational  requirements.  Therefore  the 
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effect  of  SDF  on  USAF  requirements  determination  remains  unknown.  This  is  a  problem 
because  budget  allocation  across  items  depends  on  solving  the  statistical  problem  of 
forecasting  item  demand  rates  (Sherbrooke,  1987:  v). 

Purpose  of  the  Study 

The  purpose  of  this  study  is  to  evaluate  and  compare  the  performance  and 
accuracy  of  the  Navy  forecasting  system.  Statistical  Demand  Forecasting,  relative  to  the 
Air  Force  forecasting  system  (Requirements  Data  Bank  Forecasting)  in  an  Air  Force 
environment 

Contributions  and  Implications  for  POD  Mana£eis 

The  purpose  of  this  research  is  to  compare  the  Air  Force  forecasting  approach  to 
the  Navy  forecasting  approach.  This  comparison  analysis  provides  the  Air  Force  and  the 
Joint  Logistic  Systems  Center  the  following  contributions: 

1.  Observations  on  the  forecasting  approaches' weaknesses  and  strengths.  The 
implications  associated  with  this  contribution  are  that  the  managers  will  have  greater 
understandings  of  the  forecasting  systems  and  will  know  the  areas  where  they  can 
concentrate  efforts  in  developing  and  improving  the  forecasting  systems. 

2.  Recommendations  on  which  forecasting  approach  would  be  most  accurate  and 
useful  to  the  Air  Force.  One  of  the  implications  associated  with  this  contribution  is  that 
the  Air  Force  managers  will  be  able  to  decide  whether  to  keep  the  RDB  forecasting 
approach  or  accept  the  SDF  forecasting  approach.  The  forecasting  approach  on  which 
Air  Force  managers  will  concentrate  their  efforts  to  improve  requirements  determination 
accuracy,  is  another  implication  associated  with  this  contribution. 

3.  Information  for  the  JLSC  concerning  their  deci.sion  on  SDF.  JLSC  .selected 
SDF  as  a  near  terra  initiative  (Moore,  1994).  The  implication  connected  with  this 
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contribution  is  that  it  will  help  the  JLSC  managers  decide  whether  they  should  invest  in 
the  development  and  improvement  of  the  RDB  system  versus  the  development  and 
improvement  of  the  SDF  system.  The  selection  of  the  appropriate  forecasting  system  is 
also  important  because  requirements  determination  is  based  on  forecasts  of  past  demands. 
If  the  forecasts  are  not  accurate,  DOD  managers  could  buy  the  wrong  parts  and  degrade 
weapon  system  availability  as  a  result 

Research  Questions 

The  research  questions  support  the  comparison  between  the  Navy  forecasting 
system  and  the  Air  Force  forecasting  system.  To  address  forecasting  accuracy  and 
robustness,  the  following  research  questions  are  developed: 

1.  How  does  each  forecasting  system  perform  with  different  data  pattern  components? 

a)  What  is  the  difference  between  the  RDB  average  forecasting  error  and  the  SDF 
average  forecasting  error  when  a  trending  component  is  present  in  the  data? 

b)  What  is  the  difference  between  the  RDB  average  forecasting  error  and  the  SDF 
average  forecasting  error  when  a  cyclic  component  is  present  in  the  data? 

c)  What  is  the  difference  between  the  RDB  average  forecasting  error  and  the  SDF 
average  forecasting  error  when  a  seasonal  component  is  present  in  the  data? 

d)  What  is  the  difference  between  the  RDB  average  forecasting  error  and  the  SDF 
average  forecasting  error  when  a  random  component  is  pre.sent  in  the  data? 

e)  What  is  the  difference  between  the  RDB  average  forecasting  error  and  the  SDF 
average  forecasting  error  when  an  outlier/spike  component  is  pre.sent  in  the  data? 

2.  How  accurate  are  the  forecasts  computed  by  each  forecasting  technique  subject  to 
actual  Air  Force  demand  data? 

a)  What  are  the  mean,  variance  and  standard  error  of  the  forecasting  errors? 

b)  Are  the  forecasts  responsive  to  actual  observations? 
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c)  What  is  the  difference  between  the  RDB  average  forecasting  error  and  the  SDF 
average  forecasting  error? 

3.  What  effects  do  the  forecasts,  computed  by  each  forecasting  approach,  have  on  aircraft 
availability? 

a)  What  is  the  difference  between  the  aircraft  availability  achieved  with  SDF  stock 
levels  and  the  aircraft  availability  achieved  with  the  RDB  stock  levels? 

Some  of  the  possible  moderating  variables  that  may  affect  the  results  of  the 
research  questions  are; 

1)  Two  vs.  three  level  maintenance  (procedure  change). 

2)  Variance  in  the  actual  demand  data  due  to  new  world  situations  (wartime). 

3)  A  reduction  in  peacetime  flying  due  to  budget  cuts  (less  demands). 

Research  Hypotheses 

To  answer  the  first  research  question,  an  hypothesis  is  developed  for  each  time 
series  components.  Considering  each  data  pattern  component,  the  null  hypothesis  to  be 
tested  is  that  the  RDB  forecasting  error  mean  (fii)  is  equal  to  the  SDF  forecasting  error 
mean  (|I2)  the  90%  confidence  level. 

Ho:  Pi  =M2 
Ha:  in  7^1X2 

To  answer  the  second  research  question,  the  null  hypothesis  to  be  tested  is  that  the 
RDB  forecasting  error  mean  (m)  is  equal  to  the  SDF  forecasting  mean  {\i2)  at  the  90% 
confidence  level. 

Ho:m  =42 

Ha:  41  ^^^^2 

To  answer  the  third  research  question,  the  evaluation  of  aircraft  availability,  the 
null  hypothesis  to  be  tested  is  that  the  average  aircraft  availability  (pj)  achieved  with  the 
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RDB  forecasting  approach  is  equal  to  the  average  aircraft  availability  (|i2)  achieved  with 
the  SDF  forecasting  approach  at  the  90%  confidence  level. 

Ho:pi=|i2 

Ha:pi9tp2 

Research  Approach 

Three  analytical  approaches  are  used  to  evaluate  and  compare  the  Air  Force 
forecasting  method  (RDB)  to  the  Navy  forecasting  method  (SDF): 

1.  The  first  approach  measures  the  performance  of  the  two  forecasting  techniques  in 
terms  of  accuracy  and  stability  under  the  influence  of  different  data  pattern  components. 
Forecasting  measurement  errors  are  used  to  measure  the  stability  and  accuracy  of  the 
forecasts. 

2.  The  second  approach  measures  the  performance  of  the  forecasting  techniques  in  terms 
of  accuracy  and  stability  under  the  influence  of  real  Air  Force  data.  Forecasting 
measurement  errors  are  used  to  measure  the  stability  and  accuracy  of  the  forecasts. 

3.  The  third  approach  consists  of  computing  the  aircraft  availability  achieved  when 
demand  is  estimated  by  one  of  the  forecasting  techniques  and  the  Aircraft  Availability 
Model  is  constrained  by  a  specific  funding  level.  The  Aircraft  Availability  Model  is  used 
to  compute  the  associated  aircraft  availability. 

Scope  and  Limitations 

This  research  limits  its  analysis  to  the  range  of  reparable  spare  parts.  For  this 
reason,  the  sample  size  of  the  reparable  spare  parts  includes  items  that  are  specific  and 
common  to  different  weapon  systems.  Although  the  Navy  Statistical  Demand  Forecasting 
approach  and  the  RDB  Forecasting  approach  contain  various  forecasting  techniques,  this 
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study  also  limits  itself  to  the  comparison  of  the  moving  average  technique  used  by  each 
system. 

Reparable  Items.  There  are  two  types  of  spare  parts  -  consumable  spare  parts  and 
reparable  spare  parts.  A  consumable  spare  part  is  an  item  that  is  normally  expended  or 
used  beyond  recovery,  in  the  use  for  which  it  was  designed  or  intended  (Pohlen,  1994; 
Gluck,  1970;  105).  A  reparable  spare  part  is  an  item  which  can  be  reconditioned  or 
repaired  for  re-use  when  it  becomes  unserviceable.  Such  items  are  usually  high  valued 
items  (Pohlen,  1994;  Gluck,  1970:377). 

The  purpose  of  the  Recoverable  Item  Process  in  the  Requirements  Data  Bank 
System  is  to  manage  reparable  spare  parts  (Gitman,  1994).  Although  RDB  will  have  the 
capability  of  managing  consumable  items  in  the  future,  the  Air  Force  currently  manage.s 
consumable  items  using  the  Economic  Order  Quantity  Buy  Budget  Computation  System 
(D062)  (Gitman,  1994).  Since  a  comparison  is  made  to  address  Air  Force  concerns,  this 
research  only  limits  its  analysis  to  the  range  of  Air  Force  reparable  spare  parts. 

Population  Size  and  Sample  Size.  The  population  size  of  the  reparable  items  for 
the  Department  of  Defense  is  approximately  600,000  items  (Lucas,  1994;  Maitland. 

1994b;  Wehde,  1994a).  The  population  size  of  the  reparable  items  for  the  Air  Force  is 
approximately  185,000  items  (Lucas,  1994).  The  demands  for  every  item  and  for  every 
weapon  system  are  totaled  from  each  base  and  reported  as  an  overall  worldwide  quantity. 

There  are  two  types  of  items:  specific  items  and  common  items.  Specific  items 
represent  items  that  have  application  to  one  weapon  system.  Common  items  represent 
items  that  have  applications  to  two  or  more  weapon  systems.  Eighty-five  percent  of  the 
total  reparable  items'  population  are  specific  to  weapons  systems  while  fifteen  percent  are 
common  to  different  weapon  systems  (Lucas,  1994). 

The  data  sample  consists  of  245  reparable  items.  Specific  items  and  common 
items  are  included  in  the  analysis.  Chapter  Three  of  this  thesis  details  the  computation  of 
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the  sample  size.  The  secondary  demand  data  were  gathered  from  the  Recoverable 
Consumption  Item  Requirements  (D041)  System.  The  demand  data  cover  four  years  of 
historical  data  and  are  specific  or  common  to  different  weapon  systems.  It  included 
quarterly  information  such  as  the  quantity  demanded  and  the  flying  program  for  each  item. 

Forecasting  Techniques.  The  Navy  Statistical  Demand  Forecasting  approach  and 
the  RDB  Forecasting  approach  offer  a  variety  of  forecasting  techniques  to  predict 
demands.  For  example,  the  Navy  Demand  Forecasting  approach  offers  various 
forecasting  techniques  such  as  exponential  smoothing,  double  exponential  smoothing, 
moving  average,  and  linear  regression  (Urban,  1993c).  The  RDB  Forecasting  approach 
uses  linear  regression,  exponential  smoothing  and  moving  average  as  forecasting 
techniques  (Lucas,  1993). 

Both  forecasting  systems  have  three  forecasting  techniques  in  common:  moving 
average,  double  exponential  smoothing  and  linear  regression.  The  technique  most  often 
used  by  each  system,  approximately  90%  of  the  time,  is  the  moving  average  forecasting 
approach  (Searock,  1993;Ch  3, 4;  Maitland,  1994a).  For  this  reason,  this  research  limits 
itself  to  the  comparison  of  the  moving  average  technique  used  by  each  .sy.stem. 

Assumptions 

The  analysis  of  this  research  adopts  the  following  assumptions: 

1)  The  reparable  spares  demands  are  correlated  with  flying  hours.  This  assumption  is 
important  because  the  Air  Force  forecasts  demand  rates  and  not  actual  demands.  The 
demand  rates  are  computed  by  dividing  the  number  of  demands  by  the  number  of  flying 
hours. 

2)  The  actual  spare  part  demand  data  are  assumed  to  be  specific  to  one  fictitious  weapon 
system.  Since  the  sample  size  includes  items  from  different  weapon  sy.stems,  it  would  be 
difficult  to  measure  a  significant  aircraft  availability  for  each  weapon  system.  For  this 
reason,  it  is  assume  that  all  items  are  part  of  an  imaginary  or  fictitious  weapon  system. 
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3)  The  actual  spare  part  demand  data  are  assumed  to  be  all  LRUs  (Line  Replaceable 
Units)  with  a  quantity  per  application  equal  to  one. 

4)  The  probability  of  having  x  units  in  resupply  follows  a  negative  binomial  probability 
distribution  (Rexroad,  1992:6). 

5)  The  reparable  demand  process  follows  the  Palm's  Theorem.  The  Palm's  Theorem  is 
described  as; 

If  demand  for  an  item  is  a  Poisson  process  with  annual  mean  X  and  if  repair  time 
for  each  unit  is  independently  and  identically  distributed  according  to  any 
distribution  with  mean  T  years,  then  the  steady-state  probability  distribution  fur 
the  number  of  units  in  repair  has  a  Poisson  distribution  with  mean  XT. 
(Sherbrooke,  1992:21) 

6)  The  model  structure  and  its  parameters  stay  the  same  during  the  forecast  period.  This 
implies  that  the  forecast-generating  process  is  in  control  and  that  the  forecast  errors  are 
normally  distributed  overtime  (Abraham  and  Ledolter,  1983:374). 


Chapter  Summary  and  Organization  of  the  Re.search 

This  chapter  presented  the  problem  of  comparing  the  Air  Force's  Requirements 
Data  Bank  forecasting  approach  to  the  Navy's  Statistical  Demand  forecasting  approach. 
This  chapter  also  described  the  specific  problem,  reviewed  the  research  questions  and 
delineated  the  scope  of  the  research.  Chapter  Two  describes  the  current  Air  Force 
Requirements  System,  the  future  Air  Force  Requirements  Data  Bank  Sy.stem  and  the 
Navy's  Statistical  Demand  Forecasting  System.  Chapter  Three  discusses  the  research 
methodology.  Chapter  Four  presents  the  results  and  analysis  of  the  data  collected. 
Finally,  Chapter  Five  provides  the  conclusions  and  recommendations  derived  from  the 
research. 


This  chapter  discusses  the  current  forecasting  concepts  and  presents  different 
logistics  systems  implicated  in  the  research.  First,  the  chapter  gives  a  description  of  the 
magnitude  of  the  Air  Force  reparable  items  inventory.  Then,  time  series  components  are 
presented  and  different  forecasting  techniques  are  discussed.  Finally  an  overview  of  the 
current  Air  Force  D041  system,  the  Requirements  Data  Bank  System,  and  the  Statistical 
Demand  Forecasting  System  is  presented. 

Magnitude  of  the  Air  Force  Reparable  Items  Inventory 

The  United  States  Air  Force  is  one  of  the  largest  buyers  of  goods  and  materials  in 
the  world  (Sysdek,  1989:5).  Approximately  185,000  reparable  items  are  stocked  in  the 
Air  Force  Materiel  Command  (AFMC)  inventory  for  support  of  weapon  systems  (Lucas, 
1994).  With  such  large  purchasing  needs  lies  the  inherent  responsibility  to  manage  assets 
in  an  "effective  and  efficient"  manner  (Department  of  the  Air  Force,  1987:Ch  2, 45). 

Once  an  item  is  purchased,  it  is  either  used  or  held  in  inventory  until  needed  or 
deemed  in  excess  to  requirements  (Sysdek,  1989:5).  Too  little  inventory  may  harm  the 
Air  Force  operational  needs  in  both  peace  and  war  because  of  stockouts  (Searock, 
1992:Ch  1,1).  On  the  other  hand,  too  much  inventory  increases  operating  costs  (Sysdek. 
1989:5;  Ammer,  1980:255-257)^  As  Ammer  notes,  inventories  act  as  a  protection  against 
uncertainties  in  supply  and  demand  (Sy.sdek,  1989:5;  Ammer,  1980:257).  Inventory  is  an 
important  aspect  of  efficient  materiel  management  because  the  major  goals  of  materiel 
management  are  to  minimize  inventory  investment,  maximize  customer  service  and  assure 
efficient  operation  of  the  organization  (Tersine,  1988: 16).  The  Air  Force  currently  uses 
the  Recoverable  Consumption  Item  Requirements  Sy.stem  (D041)  to  manage  its  reparable 
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items  (Department  of  the  Air  Force,  1991:32).  Because  today’s  technological  advances 
offer  opportunities  for  improvement  to  the  current  system,  D041  is  technically  archaic 
(Searock,  1992:Ch  1,  1-2).  In  July  1982,  the  AFMC  established  the  Logistics 
Management  Systems  (LMS)  Modernization  Program.  In  June  1985,  the  Secretary  of 
Defense  directed  the  services  to  strengthen  their  weapon  systems  management  approach. 
The  new  Requirements  Determination  System  (RDB)  is  one  of  the  Air  Force  programs 
that  implemented  that  directive.  Since  1985,  the  Air  Force  has  been  developing  RDB  to 
manage  807,000  consumable  spares,  recoverable  spares,  repair  parts,  and  equipment  items 
with  an  inventory  valued  at  $59  billion  (Searock,  1992:Ch  1,  1-2).  The  Air  Force  plans  to 
replace  the  current  D041  system  with  the  Recoverable  Item  Process  of  RDB  (Department 
of  the  Air  Force,  1988;Ch  2,  1). 

Time  Series  Components 

A  time  series  component  is  a  pattern  produced  by  a  set  of  time  ordered 
observations  found  during  successive  and  equal  periods  (Tersine,  1988:  41).  John  E. 
Hanke  and  Arthur  G.  Reitsch  stipulate  that  two  considerations  are  involved  in  producing 
an  accurate  and  useful  forecast  of  a  time  .serie.s.  The  first  consideration  is  to  collect  data 
that  are  relevant  to  the  foreca.sting  task.  The  .second  consideration  is  to  choo.se  a 
forecasting  technique  that  will  utilize  the  information  contained  in  the  time  series 
components  to  its  fullest  (Hanke  and  Reitsch,  1992:90). 

Time  series  components  can  be  decompo.sed  into  patterns  such  as  trend,  cycle, 
seasonality,  and  randomness  known  as  time  series  components  (Hanke  and  Reitsch. 

1 992:9 1 ).  The  four  components  are  illustrated  in  figure  2- 1 . 

The  trend  is  the  long-term  component  that  represents  the  growth  or  decline  in  the 


time  .series  over  an  extended  period  of  time.  The  basic  forces  that  affect  and  help  explain 
the  trend  component  are  population  growth,  price  inflation,  technological  change,  and 


productivity  increases  (Hanke  and  Reitsch,  1992:92).  In  a  military  environment,  an 
increase  or  a  decrease  in  operational  activities  could  explain  the  trend  component  The 
cyclical  component  is  the  wave-like  fluctuation  around  the  trend,  usually  affected  by 
general  economic  conditions  (Hanke  and  Reitsch,  1992:92). 


Figure  2-1.  Time  Series  Components  (Adapted  from  Tersine,  1988:42) 

The  seasonal  component  is  the  pattern  of  change  that  repeats  itself  year  after  year. 
Seasonal  variation  may  reflect  weather  conditions,  holidays,  or  length  of  calendar  months 
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(Hanke  and  Reitsch,  1992:92).  The  random  component  measures  the  variability  of  the 
time  series  after  the  other  components  havf  been  removed  (Hanke  and  Reitsch,  1992:93). 
Random  variations  are  those  in  the  data  which  cannot  be  accounted  for  otherwi.se  and 
have  no  identifiable  pattern  (Sysdek,  1989:18). 

Forecastine  Techniques 

The  Requirements  Data  Bank  System  and  the  Statistical  Demand  Forecasting 
System  contain  alternative  forecasting  techniques.  Item  managers  may  select  a  certain 
forecasting  technique  depending  on  the  pattern  projected  by  the  data. 

The  current  Air  Force  D041  System  uses  an  eight  quarter  moving  average  and 
PRELOG  (Predictive  Logistics)  as  forecasting  techniques.  The  USAF  decided  on  the 
eight  quarters  moving  average  technique  for  two  reasons:  the  users  can  easily  understand 
the  model,  and  the  technique  provides  stable  forecasts  under  fluctuating  demand 
(Rexroad,  1993a).  The  USAF  decided  on  Predictive  Logistics  technique  for  its  capability 
to  detect  and  respond  to  a  trend  (Department  of  the  Air  Force,  1991:585). 

The  Requirements  Data  Bank  System  pos.se.s.ses  four  different  forecasting 
techniques:  moving  average  (four  and  eight  quarters),  double  exponential  smoothing, 
linear  regression  known  as  PRELOG  (Predictive  Logistics),  and  manually  input  estimates 
(primarily  used  for  new  items)  (Searock,  1992:Ch  4. 2).  These  four  forecasting 
techniques  were  selected  to  create  greater  flexibility  for  the  item  manager  or  the 
equipment  specialist  to  respond  to  changing  demand  patterns  (Searock,  1992:Ch  4,2). 

The  Stati.stical  Demand  Forecasting  System  (SDF)  has  a  variety  of  forecasting 
techniques  for  different  demand  patterns:  moving  average,  exponential  smoothing,  double 
exponential  smoothing,  linear  regre.ssion,  non-parametric.  Sen  median  regression, 
damped,  and  composite  forecasting  (Urban,  1993c).  These  forecasting  techni'jues  were 
.selected  to  create  greater  flexibility  for  the  item  manager  or  the  equipment  specialist  to 
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choose  an  appropriate  technique  depending  on  the  demand  pattern  components  (Maitland, 
1994b). 

Although  both  forecasting  systems  have  several  forecasting  techniques,  the 
technique  used  approximately  90%  of  the  time  is  the  eight  quarters  moving  average 
forecasting  approach  (Searock,  1993:Ch  3, 4;  Maitland,  1994a). 

Moving  Average.  The  moving  average  is  a  forecasting  technique  where  a  constant 
number  of  data  points  can  be  specified  at  the  outset  and  a  mean  computed  for  the  most 
recent  observations.  As  each  new  observation  becomes  available,  a  new  mean  can  be 
computed  by  dropping  the  oldest  value  and  including  the  newest  one  (Hanke  and  Reitsch, 
1992: 134).  The  moving  average  technique  can  be  very  responsive  to  big  changes  in  the 
data  pattern  if  the  number  of  periods  in  the  moving  average  is  small.  On  the  other  hand, 
the  technique  can  be  very  stable  if  the  number  of  periods  in  the  moving  average  is  large. 
The  rate  of  response  to  changes  in  the  underlying  data  pattern  depends  on  the  number  of 
periods  in  the  technique.  The  moving  average  model  performs  best  with  stationary  data; 
however,  it  does  not  handle  trend  or  seasonality  very  well  (Hanke  and  Reitsch,  1992:134- 
135).  Equation  1  provides  the  formula  for  the  moving  average  forecasting  technique 
(Hanke  and  Reitsch,  1992:134). 

Pt-Hl  =  (Yt+Yt-i+Yt.2+...+Yt.n+i)/ n  (I) 

where 

Yt=  Actual  datum  in  quarter  t 

Ft+ 1=  Forecast  made  in  quarter  t  for  t-t- 1 

n=  number  of  terms  in  the  moving  average 

Exponential  Smoothing.  Exponential  smoothing  is  a  method  based  on  averaging 
(smoothing)  past  values  of  demands  in  a  decreasing  (exponential)  manner.  The 
observations  are  weighted  with  more  weight  given  to  more  recent  observations  (Hanke 
and  Reitsch,  1992:140).  One  advantage  of  exponential  smoothing  is  that  it  is  a  simple 
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technique  and  requires  veiy  little  historical  data  (Evans,  1993:740).  It  is  very  responsive 
to  changes  in  data  patterns  because  more  weight  is  given  to  the  most  recent  observation. 
Equation  2  demonstrates  the  exponential  smoothing  equation  (Hanke  and  Reitsch. 
1992:140). 

Ft+i=aYt+(l-a)*Ft  (2) 

where 

¥{=  Actual  datum  in  month  t 
Ft^.i=  Forecast  made  in  month  t  for  t+I 
Ft=  Forecast  made  in  month  t 
a=  Smoothing  Constant  (0<a<l) 

Double  Exponential  Smoothing.  The  double  exponential  smoothing  technique, 
often  referred  to  as  Brown's  Method,  is  used  as  an  exponential  smoothing  technique  for 
forecasting  demand  data  that  have  a  linear  trend  (Hanke  and  Reitsch,  1992: 146).  A 
disadvantage  with  double  exponential  smoothing  is  the  initialization  of  the  smoothed  series 
variables  and  the  trend  adjustment  variable.  Also,  if  no  trend  is  present  in  the  data,  the 
forecast  may  be  underestimated  or  overestimated  (Hanke  and  Reitsch,  1992: 150). 

Equation  3  demonstrates  the  double  exponential  .smoothing  technique  (Hanke  and  Reitsch. 
1992:146). 

At  =  aYt+(l-oc)*At.i  (3) 

A’t  =  aAt+(l-a)*A't.i 

at  =  2At+A't 

bf  =  (a  /  1-a)  *  (At  -  A't) 

Ft+p  =  H  +  (bt*P) 

where 

Yt=  Actual  datum  in  period  t 
Ft+ 1=  Forecast  made  in  period  t  for  t+1 
Ft=  Forecast  made  in  period  t 
a=  Smoothing  Constant  (0<a<  1 ) 

At  =  new  smoothed  value 
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Linear  Regression.  Once  a  linear  relationship  is  established,  knowledge  of  an 
independent  variable  can  be  used  to  forecast  a  dependent  variable  (Hanke  and  Reitsch, 
1992:178).  The  method  used  to  determine  the  regression  equation  is  called  the  method  of 
least  squares  (Hanke  and  Reitsch,  1992:180).  Although  the  model  is  very  responsive  to 
any  type  of  trend  patterns,  one  disadvantage  with  linear  regression  is  that  it  is  complex  and 
not  easily  understood  by  the  user  (Searock,  l992:Ch  3, 2).  The  mathematical  formula  for 
the  regression  equation  is  illustrated  in  Equation  4  (Hanke  and  Reitsch,  1992:181). 

Y  =  a  +  bX  (4) 

a  =  Y  -  bX 

b  =  (SXiYj-nX  Y)/(lXi2-nX2) 

Recoverable  Consumption  Item  Requirements  Sv.stem  (D04I) 

The  previous  section  discussed  about  a  variety  of  forecasting  techniques  that  can 
be  used  to  forecast  future  demands.  This  section  describes  the  current  Air  Force 
requirements  system  and  discuss  which  forecasting  techniques  it  uses  to  forecast  future 
demands.  The  current  Air  Force  requirements  system  known  as  the  Recoverable 
Consumption  Item  Requirements  System  (D041)  has  been  designed  to  support  the 
reparable  requirements  function  for  the  Air  Force.  It  has  the  following  functions 
(Department  of  the  Air  Force,  1992:32): 

1.  Computes  spare  parts  requirements  for  recoverable  items. 

2.  Accomplishes  the  routine  clerical,  mathematical,  and  statistical  workload 
involved  in  computing  recoverable  item  requirements. 

3.  Forecasts  gross  and  net  requirements  using  past  and  future  programs,  usage 
history,  and  asset  information  maintained  within  this  system. 

4.  Produces  reports  for  management  evaluation  and  action. 

5.  Produces  information  for  logistics  systems. 
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It  uses  an  eight  quarter  moving  average  as  a  forecasting  technique  to  predict  future 

spare  part  requirements  for  weapon  systems  (Department  of  the  Air  Force,  1992:583). 

D04rs  eight  quarter  moving  average  computes  a  demand  rate  known  as  the 

Organizational  Intermediate  Maintenance  Demand  Rate  (Department  of  the  Air  Force, 

1992:556).  The  demand  rate  is  then  multiplied  by  planned  future  flying  hours  to  compute 

future  spare  part  requirements.  The  equation  for  the  eight  quarter  moving  average 

technique  in  D041  is  demonstrated  in  Equation  5  (Lucas,  1993). 

Ft+i=(lDi/lPi),  i  =  (t)to(t-7)  (5) 

Demand  =  (Number  projected  to  fly  at  t+1)  x  (Ft+i) 

Ft+i  =  Forecasted  value  for  quarter  t+1 

Di  =  Demand  value  at  quarter  i 

Pj  =  Number  of  flying  hours  at  quarter  i 

t  =  Quarter  i 

To  further  explain  the  eight  quarter  moving  average,  the  following  example  is 
considered.  A  type  of  aircraft  in  the  Air  Force  is  projected  to  fly  150  hours  in  the  next 
quarter.  What  would  be  the  requirement  for  landing  gears  in  the  next  quarter?  Table  2- 1 
gives  more  information  pertaining  to  past  demands  on  the  landing  gear. 


Table  2-1.  Landing  Gear  Demands 


1 

2 

100 

2 

3 

100 

3 

4 

75 

4 

I 

125 

5 

2 

75 

6 

2 

100 

7 

3 

150 

8 

3 

75 

Total: 

20 

800 

9 
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F9  =(lDi/lPi) 

=  ( 20  /  800)  =  0.025  Demands  per  flying  hour 

Dg  =  0.025  X  150  flhrs  =  3.75  landing  gears  projected  for  quarter  9 

PRELOG  (Predictive  Logistics)  is  another  forecasting  technique  incorporated  into 
D041.  Although  the  technique  is  available  for  use,  it  is  rarely  used  to  compute  factors  or 
rates  because  of  its  complexity  (Rexroad,  1993a).  The  technique  is  discussed  in  the 
description  of  the  RDB  System. 

Deficiencies  within  the  D041  system  addressed  by  the  RDB  system  are  (Searock. 
1992:Ch3,2-10): 

1)  Forecasting  techniques  for  recoverable  items  are  limited  in  scope. 

2)  No  capability  to  recompute  requirements  to  reflect  a  changing  environment. 

3)  Historical  data  are  not  readily  accessible. 

4)  There  is  no  capability  to  accommodate  surge  in  processing  requirements. 

5)  Stock  list  changes  are  not  received  in  a  timely  manner. 

6)  Access  to  data  is  not  adequately  controlled  in  current  systems. 

Requirements  Data  Bank  Sv.stem 

Introduction.  Because  technological  advances  offer  opportunities  for  material 
management  improvement  the  current  AFMC  logistics  systems,  developed  in  the  1950s 
and  1960s,  are  technically  archaic.  For  this  reason,  the  Requirements  Data  Bank  is  part  of 
a  modernization  program  known  as  the  Logistics  Management  Systems  (LMS) 
Modernization  Program  initiated  by  AFMC  in  1982.  RDB  is  currently  being  developed  by 
the  Air  Force  and  consists  of  automated  and  manual  functions  to  forecast  and  control 
procurement  and  repair  requirements  of  assets  needed  for  logistics  support  of  USAF 
weapon  systems  (Searock,  1992:Ch  1,1).  It  is  designed  to  compute  requirements  for  buy 
and  repair  for  807,000  consumable  spare.s,  recoverable  spares,  repair  parts,  and  equipment 


2-9 


items  with  an  inventory  valued  at  $59  billion  (Searock,  1992:Ch  1,  1-2).  One  of  the  RDB 
objectives  is  to  improve  the  accuracy,  visibility  and  timeliness  of  data,  thus  reducing 
paperwork  and  increase  asset  visibility  (Department  of  the  Air  Force,  1988:2-17). 

Replacement  of  Existing  Systems  bv  RDB.  The  Air  Force  use.s  many  logistics 
inforraation  systems  to  manage  their  assets.  One  of  the  functions  of  materiel  management 
is  the  Materiel  Requirements  Process.  The  Air  Force  Materiel  Requirements  Process 
computes  procurement  requirements  for  equipment,  spares,  and  repair  parts,  and 
determines  depot  maintenance  repair  needs.  Searock  defines  requirement  as  "the  function 
or  process  of  applying  available  or  projected  inventory  against  a  forecasted  need  to 
determine  a  shortage  or  excess  exists,  or  if  the  items  in  an  optimum  position."  (Searock. 
I992:Ch3,I).  The  RDB  provides  such  a  system  for  the  Materiel  Requirements  Process, 
which  is  divided  into  six  major  functional  areas;  Recoverable;  Equipment;  Expense; 
Finance;  Repair;  and  Support  (Searock,  1992;Ch3,  1).  Table  2-2  illustrates  the  current 
Air  Force  systems  of  the  Materiel  Requirements  Process  that  RDB  will  replace  (Searock, 
1992:Ch  3,  1-2). 

RDB  Suh-svstems.  The  RDB  is  being  developed  using  a  relational  data  ba.se 
management  system.  A  relational  data  base  management  system  represents  the  newest 
technology  in  data  base  management  (Searock,  1992.Ch  4,  10).  The  Requirements  Data 
Bank  system  is  made  up  of  multiple  physical  processes,  referred  to  as  sub-systems,  or 
CPCIs  (Computer  Program  Configuration  Items).  These  sub-systems,  together,  make  the 
RDB  system  and  replace  the  current  Air  Force  systems  illustrated  in  Table  2-2.  Table  2-3 
demonstrates  the  twenty-one  CPCIs  or  .sub-sy.stems  that  compo.se  the  RDB  system. 

RDB  Recoverable  Item  Sub-sv.stem.  The  Recoverable  Item  Sub-sy.stem  (D200.A) 
is  one  of  the  processes  that  compose  the  RDB  system.  This  study  only  discu.sses  the  RDB 
Recoverable  Item  Sub-system  because  the  research  focuses  on  the  forecasting  aspects  of 
this  sub-system.  The  Recoverable  Item  Sub-system  computes  repair,  acqui.sition,  and 


2-10 


Table  2-2.  Current  Air  Force  Systems  Replaced  by  RDB 


con 

Special  Tooling  and  Special  Test  Equipment  System 

D039 

Computation  of  Requirements  for  Equipment  Items 

D041 

Recoverable  Consumption  Item  Requirements  System 

D041A 

Recoverable  Consumption  Item  Requirements  System 

D049 

Master  Material  Suppon  Record 

D055 

Stock  Fund  War  Requirements 

D058 

Economic  Order  Quantity  (EOQ)  Wartime  Requirements  Computation 
Gunnery  Equipment 

D062 

Economic  Order  Quantity  (EOQ)  Buy/Budget  Computation  System 

D067 

Defense  Materiel  Utilization  and  Disposition  Program  Management 

System 

D072 

Other  War  Reserve  Materiel  Requirements 

D073 

Repair  Requirements  Computation  System 

D085 

Air  Force  Requirements  Forecasting  System 

D141A 

Base  Consolidation  Inventory  Status  &  Transaction  Report  Table  III  Items 

D141B 

AF  Consolidated  Inventory  Status  &  TransacUon  Report  Table  III 

G033J 

Past  Programs  Data  System 

C3035B 

Central  Management  of  Depot  Level  Maintenance 

G072E 

Depot  Level  Maintenance  Requirements  and  Program  Management  System 

G079 

Systems  and  Equipment  Modification/Maintenance  Program 

K004 

Program  Data  for  Input  to  Consumption  Requirements  Computation 

APIS 

Application  Program  Information  System 

IRCMIS 

Initial  Requirements  Computation  and  Management  Information  System 

WARS 

Wartime  Assessment  and  Requirements  Simulation  (WARS)  Model 
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Table  2-3.  RDB  Sub- systems 


W’X-:-: 

; 

D200.A 

Recoverable  Item  Process 

D200L 

Equipment  Item  Requirements 
Inventory  Analysis  Report 

D200.B 

Expense  Item  Process 

<  ' 

D200.M 

Economic  Order  Quantity  Depot 
DataBase 

D200.C 

Equipment  Item  Process 

D200.N 

Recoverable  Item  Surauficuuon 

D200.D 

Repair  Process 

<  ^ 

D200.0 

Economic  Order  Quantity  Item 
Stratification 

D200.E 

Requirements  Items 
Identification  Data  Process 

D200.P 

Past/Projected  Programs  Data 

D200.F 

Application  &  Programs 
Indenture  Process 

D200.1 

Adminisuation  imd  Support 

D200.G 

War  Readiness  Spares 

Kit/Base  Level  self- 
sufficiency  Spares  Process 

•k> 

D200.2 

Computations  Methods 
Management 

D200.H 

Initial  Requirements 
Determination  Process 

D200.5 

Data  Base  Management  System 

D200.I 

Retail  Item  Stratification 

D200.9 

Planning,  Programming, 
Budgeting  System 

D200.J 

Special  Tooling  and  Special 
Test  Equipment  Process 

D200.7 

User  Problem  Report  System 

D200.K 

Disposal  Process 

retention  requirements  for  reparable  items  (Searock,  1992:Ch  1,  10).  The  major  functions 
of  the  Recoverable  Item  Sub-system  are  (Searock,  1992;Chl,  11-12); 

1.  Collect,  maintain,  and  retrieve  item  data. 

2.  Collect,  maintain,  and  retrieve  weapon  .system/end  item  data. 

3.  Collect,  manage  financial  data. 

4.  Perform  management  analysis. 

5.  Compute  item  gro.ss/net  requirements  by  forecasting  factors. 

6.  Compute  stock  levels  using  Aircraft  Availability  Model. 

The  RDB  Recoverable  Item  Sub-sy.stem  contains  four  different  forecasting 
techniques;  moving  average  (four  &  eight  quarters),  double  exponential  smoothing,  linear 
regression  known  as  PRELOG  (Predictive  Logistics),  and  manually  input  e.stimates 


(primarily  used  for  new  items)  (Searock,  1992;Ch  4, 2;  Lucas,  1993). 
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RDB  Moving  Average.  The  formula  for  the  moving  average  technique  in 
the  Requirements  Data  Bank  System  (RDB)  is  identical  to  the  eight  quarter  moving 
average  technique  presented  in  the  Recoverable  Consumption  Item  Requirements  System 
(D041)  (Department  of  the  Air  Force,  1988:Ch  C,  286).  The  only  difference  is  that  the 
equipment  specialist  or  the  item  manager  has  the  flexibility  of  choosing  among  a  four 
quarter  moving  average  technique  or  an  eight  quarter  moving  average  technique 
(Department  of  the  Air  Force,  1988;Ch  C,  272).  The  eight  quarter  moving  average  will 
compute  a  more  stable  forecast  and  the  four  quarter  moving  average  will  be  more 
responsive  to  changes  in  the  data  pattern. 

RDB  Double  Exponential  Smoothing.  The  double  exponential  smoothing 
technique,  often  referred  to  as  the  Brown's  method,  is  used  for  forecasting  demand  data 
that  have  a  linear  trend  (Hanke  and  Reitsch,  1992: 146).  The  formula  for  the  double 
exponential  smoothing  is  illustrated  in  Equation  6  (Hanke  and  Reitsch,  1992:147). 

Ft+i  =at  +  (p)bt  (6) 

at  =  2S't-S"t 

bt  =  (ce/l-a)  (S't-S"t) 

S't  =  a(Yt)  +  (l-a)(S’t.i) 

S"t  =  a(S't)  +  (l-a)(S"t.i)  ' 

where 

Ft+i=  Forecast  made  for  period  t+1 
at  =  computed  value  for  period  t 
bt  =  computed  value  for  period  t 
p  =  number  of  period  forecasted  ahead 
Yt  =  Actual  datum  in  period  t 
S't  =  S-Prime 
S"t  =  S-Double  Prime 
a  =  Smoothing  Coefficient 
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Contrary  to  the  moving  average  technique,  which  suras  demand  over  four  or  eight 
quarters,  the  double  exponential  smoothing  technique  uses  past  Organizational 
Intermediate  Maintenance  demand  rates  as  input  data  (Department  of  the  Air  Force, 
l988:Ch  C,  274).  The  double  exponential  smoothing  technique  in  the  RDB  Recoverable 
Item  Sub-system  will  compute  five  different  forecasts  using  five  different  smoothing 
coefficients  and  will  retain  the  forecast  having  the  lowest  MAD  (Mean  Absolute 
Deviation)  value  (Department  of  the  Air  Force,  1988: Annex  C,  274). 

RDB  Predictive  Logistics  (PRELOG).  Predictive  Logistics  (PRELOG)  is  a 
forecasting  system  which  checks  up  to  twelve  quarters  of  past  demand  rates  for  a 
significant  trend  and  generates  regression  forecast  estimates  (Department  of  the  Air  Force. 
1991:585).  The  Predictive  Logistics  technique  is  a  tool  to  be  used  by  the  equipment 
specialist,  along  with  the  advice  of  an  actuary,  to  forecast  future  demand  rates.  Working 
as  a  team,  the  equipment  specialist  and  the  actuary  apply  their  experience  and  knowledge 
to  promote  optimal  use  of  the  Air  Force  resources  (Department  of  the  Air  Force,  1 98():Ch 
9,  9). 

PRELOG  uses  regression  analysis  to  make  a  forecast  and  performs  two  types  of 
testing  (Department  of  the  Air  Force,  1991:587): 

1.  The  first  test  uses  the  method  of  least  .squares  to  compute  the  best  fi^  line  for 
data.  This  test  is  designed  to  determine  if  the  slope  of  the  computed  line  is  significantly 
different  from  a  horizontal  line. 

2.  The  second  test  measures  the  error  involved  in  using  the  moving  average  to 
forecast  the  demand  rate.  Each  quarterly  demand  rate  is  compared  with  the  immediate 
preceding  moving  average. 

If  the  results  of  either  of  these  tests  equals  or  exceeds  the  Air  Logistic  Center 
determined  levels,  the  item  is  selected  for  evaluation.  A  list  of  the  items  .selected  is 
provided  to  the  actuary  and  the  equipment  speciali.st  for  review.  They,  together,  decide 
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whether  demand  rates  should  be  changed  manually  to  forecast  requirements  more 
accurately  (Department  of  the  Air  Force,  1991:587). 

Statistical  Demand  Forecasting  System 

The  Statistical  Demand  Forecasting  (SDF)  approach  was  developed  in  1992  by  the 
Navy  to  forecast  its  recoverable  and  consumable  requirements  for  program  and  non¬ 
program  related  items  (Urban,  1994a:Ch  2, 1).  SDF  was  developed  to  reduce  wholesale 
operating  cost  by  improving  forecast  accuracy  and  reducing  inventory  level  instability. 

The  SDF  approach  employs  statistical  process  control  charts  to  detect  demand  instability 
and  is  designed  to  improve  forecast  accuracy  and  to  reduce  level  instability  (Wehde, 

1994b:  1).  SDF  offers  eight  different  demand  forecasting  techniques  for  different  types  of 
commodities  (Urban,  1994a:Ch  2, 3) 

The  Statistical  Demand  Forecasting  model  forecasts  the  mean  and  variance  of  the 
net  demand  during  the  procurement  lead-time  and  the  net  demand  during  the  repair  turn¬ 
around-time  (Urban,  1994a:Ch  2,  1).  Past  observations  and  current  forecasts  on  each  item 
are  entered  in  the  SDF  system  and  both  values  are  compared  using  statistical  tests 
(Wehde,  1994b:2)  When  past  observations  are  processed  through  SDF,  the  most  recent 
observation  will  be  processed  through  a  series  of  filters  and  tests  to  ensure  that  it  is 
consistent  with  the  most  recent  forecast.  If  the  most  recent  observation  is  consistent  with 
the  most  recent  forecast,  then  SDF  will  not  change  its  current  forecast  and  will  keep  the 
same  forecast  for  the  next  period  (Wehde,  1994b:2).  However,  if  a  significant  difference 
is  found,  then  a  new  forecast  is  calculated  for  the  next  period.  If  a  major  difference  is 
found  between  the  current  forecast  and  the  most  recent  observation,  the  SDF  system  will 
download  the  item  demand  information  to  a  Personal  Computer  Exception  Tool  to  advise 
the  item  manager  of  the  situation.  The  item  manager  will  then  be  given  the  opportunity  to 
evaluate  the  situation  through  the  Personal  Computer  Exception  Tool  (Maitland,  1994b). 


2-15 


It  is  not  unusual  for  each  item  or  a  group  of  items  to  have  different  demand 
observation  patterns.  A  demand  pattern  may  demonstrate  a  trending  component,  a 
seasonality  component,  a  cyclical  component  and/or  an  irregular  component  (Hanke  and 
Reitsch,  1992:91-93).  Different  forecasting  techniques  will  perform  better  than  others 
depending  on  the  data  demand  pattern.  SDF  is  flexible  in  that  it  has  a  series  of  forecasting 
techniques  for  different  demand  pattern  situations.  These  include  (Urban,  1994a:Ch  2,  I ); 

1.  Moving  Average  5.  Non-Parametric 

2,  Exponential  Smoothing  6.  Linear  Regression 

3.  Double  Exponential  Smoothing  7.  Sen  Median  Regression 

4,  Damped  8.  Composite  Forecasting 

In  more  detail,  the  Statistical  Demand  Forecasting  System  is  divided  into  six 
modules  (Urban  1993c): 

1.  Module  0:  Administrative  Lead-time 

2.  Module  1 :  Time  Forecasts 

3.  Module  2:  Rates  Forecasts 

4.  Module  3:  Filters  and  Trends 

5.  Module  4:  Quantity  Forecasts 

6.  Module  5:  Procurement  Problem  Variable  Forecast 

The  modules  are  independent  of  each  other  and  SDF  can  be  run  using  only  one  module  or 
a  combination  of  any  modules  (Urban,  1993c),  Each  module  computes  the  values  for 
specific  variables,  which  can  then  be  used  to  feed  other  modules  within  the  SDF  system. 

Module  0  -  Administrative  Lead-time.  This  module  computes  the  administrative 
lead-time  for  each  item  (Urban,  1994b;  Urban,  1994c:3-4).  Module  0  takes  contract 
information  and  computes  the  administrative  lead-time  prior  to  contract  initiation  (Urban. 
1994b;  Urban,  1994c;3).  This  information  is  computed  by  item,  by  group  of  items  or  by 
program.  The  administrative  lead-time  depends  on  the  dollar  value  of  the  item(s)  or  the 
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contract(s)  (Urban,  I994a:Ch  3,  5).  When  the  computation  is  completed,  the 
administrative  lead-time  is  fed  to  SDF. 

Module  1  -  Time  Forecasts.  The  purpose  of  this  module  is  to  compute  the 
procurement  lead-time  and  the  repair-tum-around  lead-time  (Urban,  1994b;  Urban, 
1994c;5). 

The  Procurement  Lead-Time:  This  variable  represents  the  time  necessary 
to  procure  an  item.  The  procurement  lead-time  is  computed  by  adding  the  Administrative 
Lead-time  (computed  in  module  0)  to  the  Production  Lead-time  (Urban,  1994a:Ch  3,  5). 
The  production  lead-time  is  defined  as  the  time  necessary  to  generate  an  item  (Urban, 
1994a:Ch  3, 6).  It  is  generally  identified  and  specified  by  the  Navy  (Urban,  1994b).  The 
production  lead-time  is  forecasted  using  an  exponential  smoothing  technique  (Urban, 
l994a;Ch  3,  6). 

The  Repair  Problem  Average:  Also  known  as  the  Repair  Cycle  Time,  this 
variable  represents  the  time  required  to  repair  an  item  (Urban,  1994a:Ch  3,  10;  Urban 
1994b).  The  repair  problem  average  is  computed  using  the  following  variables  (Urban, 
1994a:Ch  3, 4): 

1.  Remain  in  Place  time.  The  length  of  time  until  a  serviceable  item  is  available  as 
a  prerequisite  for  the  removal  of  an  unserviceable  from  the  end  item  as  measured  from  the 
time  the  unserviceable  item  is  determined  to  be  beyond  the  repair  capability  of  an 
organizational/intermediate  maintenance  activity  (Urban,  1994a:Ch  4, 3). 

2.  Retrograde  time.  Time  it  takes  for  an  item  to  be  shipped  from  the  base  to  the 
depot  (Urban,  1994a:Ch  3, 4). 

3.  Overall  Retrograde  Time.  Remain  in  Place  +  Retrograde  Time  (Urban. 
1994a;Ch  3, 4). 

4.  Administrative  time.  Time  to  prepare  the  item  for  repair  (Urban,  1994b). 

5.  Depot  Maintenance  time.  Repair  time  (Urban,  1994a:Ch  3,  9). 
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6.  Depot  Repair  Problem  Average  Time.  Administrative  +  Depot  Maintenance 
(Urban,  1994a:Ch  3,  10). 

7.  Depot  Repair  Cycle  time.  Overall  Retrograde  Time  +  Depot  Repair  Problem 
Average  time  (Urban,  1994a:Ch  3, 4) 

_ Figure  2-2  illustrates  these  variables. _ 


Figure  2-2.  Repair  Turn- Around-Time 

Module  2  -  Rates  Forecasts.  SDF  computes  the  following  rates  to  determine  the 
number  of  regenerations  expected  from  repair  (Urban,  1994a:Ch  3,  11): 

1.  Final  Recovery  Rate  (FRR).  This  rate  represents  the  percentage  of  items 
inducted  into  the  repair  program  that  can  be  anticipated  to  be  returned  to  a  usable  or 
serviceable  condition. 

2.  Unserviceable  Return  Rate  (URR).  This  rate  represents  the  percentage  of  the 
total  items  issued  expected  to  be  turned  in  for  repair. 

3.  The  Washout/Condemnation  Rate  (WCR).  It  is  an  expression  of  the 
percentage  of  total  items  den,anded  that  never  return  to  a  reparable  condition. 

4.  Serviceable  Return  Rate  (SRR).  This  rate  represents  the  percentage  of  total 
items  which  are  returned  to  the  supply  .system  in  a  reparable  condition. 
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5.  Nonrecurring  Demand  Rate  (NDR).  The  NDR  is  the  percentage  of 
nonrecurring  demands. 

Module  3  -  Filters  and  Trends.  This  module  represents  the  main  component  of  the 
Statistical  Demand  Forecasting  system  (Urban,  1994b).  It  consists  of  five  independent 
statistical  process  control  tests  used  to  measure  demand  forecast  stability  (Wehde, 
1994b:2;  Urban;  1994b).  These  tests  determine  whether  the  most  current  forecast  is  still  a 
good  demand  predictor  of  the  future  (Wehde,  1994b). 

The  main  objectives  of  the  five  statistical  tests  within  this  module  are  the 
evaluation  of  the  following  elements  (Urban,  1994a:Ch  3,  14-15): 

1.  Stability  of  the  forecast.  Determine  whether  the  current  forecast  is  still  a  good 
predictor  of  the  future. 

2.  Possibility  of  a  trend.  Determine  whether  a  trend  component  exists  in  the 
demand  data  even  though  past  observations  appear  to  be  stable  for  several  consecutive 
periods. 

3.  Possibility  of  biased  demand.  Determine  if  observations  have  drifted  away  from 
the  mean  forecast  even  though  demands  are  stable  and  non-trending. 

The  most  recent  observation  will  be  compared  to  the  most  recent  forecast  using 
the  five  statistical  parametric  tests.  If  one  of  the  statistical  tests  determines  that  the 
forecast  is  not  a  good  predictor,  SDF  computes  a  new  forecast.  However,  if  all  the  tests 
determine  that  the  current  forecast  is  still  a  good  predictor,  the  current  forecast  becomes 
the  next  period's  forecast  (Wehde.  1994b:  1-5;  Urban,  1994b). 

The  five  independent  statistical  parametric  tests  that  SDF  uses  are:  The  Demand 
Filters  Test,  the  Trending  Test,  the  Bias  Test  -  Runs  Test,  the  Bias  Test  -  Cumulative 
Error  Tests,  and  the  Bias  Test  -  Student  Confidence  Interval  Test  (Urban,  1994c:7- 10, 
Wehde,  1994b:  1-5). 
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Demand  Filters  Test.  To  measure  the  stability  of  the  forecast,  SDF  uses  a 
statistical  control  test  known  as  the  Demand  Filters  Test.  The  purpose  of  the  Demand 
Filters  Test  is  to  determine  whether  the  current  forecast  is  a  good  predictor  of  the  future. 
If  the  test  demonstrates  that  the  current  forecast  is  not  a  good  estimation,  then  it  will 
reforecast  the  demand  data  to  obtain  a  new  forecast  more  representative  of  the  demand 
pattern  (Urban,  1994a:Ch  3,  15;  Wehde,  1994b;2). 

SDF  uses  a  control  chart  with  a  mean  forecast  and  regions  surrounding  the  mean. 
Those  regions  are  known  as  filters.  Figure  2-3  illustrates  the  control  chart. 
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Figure  2-3.  SDF  Statistical  Control  Chart  -  Filters  Test 
The  three  regions  on  the  control  chart  are  the  stability,  instability  and  outlier 
regions  (Wehde,  1994b:3).  The  region  into  which  a  given  demand  observation  falls 
determines  if  a  decision  is  made  about  whether  to  reforecast  demand  at  this  point  or  to 
defer  the  decision  pending  the  outcome  of  the  four  remaining  statistical  process  control 
tests. 


Stability  Region.  The  mean  on  the  control  chart  (figure  2-3) 
represents  the  forecast  currently  being  used  to  forecast  demand.  The  stability  region  is  the 
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area  around  the  mean.  Its  boundaries  are  defined  by  (Mean+Y*SD)  and  (Mean-Z*SD) 
where  Y  and  Z  are  constant  values  defined  by  the  item  manager  and  SD  is  the  standard 
deviation  of  the  forecasted  mean  (Urban,  l994a:Ch  3,  15;  Wehde,  1994b;3).  The  default 
value  of  Y  and  Z  is  one  (Maitland,  1994a).  When  the  most  recent  observation  falls  within 
the  stability  region,  the  current  forecast  is  considered  to  be  a  good  predictor  of  the  future. 
The  observation  passes  the  Filters  test  and  continues  on  to  the  Bias  tests  (Wehde, 
1994b:3).  Points  A  and  A'  on  the  control  chart  are  examples  of  observations  falling  into 
the  stable  region. 

Instability  Region.  The  instability  region  is  the  region  above  and 
below  the  stability  region  (Wehde,  1994b:3).  The  instability  region  is  defined  as  the 
region  between  (Mean+Y*SD)  and  (Mean+W*SD)  and  the  region  between  (Mean- 
Z*SD)  and  (Mean-X*SD).  Y,  W,  Z  and  X  are  constant  values  that  must  be  set  and  SD  is 
the  standard  deviation  of  the  mean  (Urban,  1994a:Ch  3,  15;  Wehde,  I994b:3).  The 
default  value  of  X  and  W  is  three  (Maitland,  1994a).  A  demand  observation  falling  into 
the  instability  region  is  a  signal  that  the  current  forecast  is  unstable  with  the  most  recent 
observation.  Therefore,  the  current  forecast  is  no  longer  representative  of  the  demand 
pattern  and  demand  has  to  be  reforecasted  using  the  forecasting  technique  selected  by  the 
item  manager  (Wehde,  1994b:3).  Points  B  and  B'  on  the  control  chart  in  figure  2-3  are 
examples  of  observations  falling  into  the  instability  region. 

Outlier  Region.  The  outlier  region  consists  of  the  region  above  and 
below  the  instability  region.  The  outlier  region  is  defined  as  the  region  above  the  value  of 
(Mean+W*SD)  and  the  region  below  the  value  of  (Mean-X*SD)  (Urban,  1994a:Ch  3,  15: 
Wehde,  1994b:3).  When  an  observation  fails  within  the  outlier  region,  it  is  considered  as 
an  outlier  and  two  options  are  po.ssible  (Maitland,  1994a).  One  of  the  two  options  can  be 
set  by  the  u.ser  as  a  parameter. 
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In  the  first  option,  when  a  single  consecutive  observation  falls  in  the  outlier  region, 
it  is  marked  high  (above  mean)  or  low  (below  mean).  The  outlier  is  dampened  or 
reduced/increased  to  a  value  equal  to  the  unstable  outer  limit.  The  forecast  is  updated 
using  the  dampened  value.  Points  C  and  C  on  the  control  chart  (figure  2-3)  are  examples 
of  observations  falling  into  the  outlier  region.  They  are  dampened  to  CO  and  CO 
respectively. 

In  the  second  option,  the  first  occurrence  of  an  outlier  is  ignored.  When  a  single 
consecutive  demand  observation  falls  in  the  outlier  region,  it  is  considered  to  be  an  error 
or  the  result  of  a  series  of  events  or  conditions  that  do  not  occur  with  a  high  probability. 
They  are  not  likely  to  occur  again  in  the  future  at  any  time  soon.  Therefore  the 
observation  is  ignored.  The  forecast  is  not  updated  and  the  observation  will  go  through 
the  Bias  tests. 

SDF  considers  two  consecutive  demand  observations  falling  in  the  same  outlier 
region  to  be  strong  evidence  that  the  true  demand  has  changed  in  a  significant  way. 
Therefore  demand  is  reforecast  when  two  consecutive  outliers  on  the  same  side  of  the 
current  forecast  are  observed  (Wehde,  1994b:5).  However,  the  standard  forecasting 
technique  selected  by  the  item  manager  is  not  used  in  this  instant.  A  four  quarter  moving 
average  step  forecast  is  computed  to  give  more  weight  to  the  two  outliers.  If  a  set  dollar 
value  is  met,  the  item  demand  information  is  then  downloaded  to  the  PC  exception  tool 
for  the  item  manager  to  review  (Maitland,  1994b). 

Figure  2-4  illustrates  the  Demand  Filters  test.  Instability  is  shown  in  Zone- 1. 
outliers  are  found  in  Zone-2,  and  stability  is  displayed  in  Zone-3.  The  scenario  starts  in 
Zone-1  with  a  current  quantity  forecast  of  9.  Demand  observations  11,8,  10, 7  and  1 1 
fall  in  the  stable  region.  Demand  observations  2  and  16  fall  within  the  outlier  region  and 
are  ignored  because  they  are  not  consecutive.  Because  demand  observation  13  falls  in  the 
instability  region,  a  new  forecast  is  computed.  The  new  current  forecast  (Zone-2)  takes 
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the  value  of  10  =  (11+8+10+7+11+13)/ 6.  In  Zone-2,  because  of  two  consecutive 
outliers,  a  new  forecast  is  computed  using  a  four  quarter  moving  average.  The  new 
current  forecast  (Zone-3)  takes  the  value  of  7  =  (10+12+3+3)  /  4. 

I  zom  1  ZONB  2  ZOHB  3 


Figure  2-4.  Demand  Filters  Test  (Adapted  from  Wehde,  1994b:5) 

Trending  Test.  The  Demand  filters  Test  is  followed  by  the  Trending  Test 
Observations  of  demand  ate  tested  to  determine  whether  there  is  a  significant  trend  in  the 
system  demand  pattern  (Urban,  1994a:Ch  3, 16).  Although  demand  displays  stability,  a 
trending  component  in  the  observations  could  exist.  Figure  2-5  illustrates  this  situation. 

SDF  uses  the  Kendall  "S"  statistic  to  make  statistical  inferences  about  the  presence 
of  a  trend.  To  determine  if  a  trend  exists,  SDF  will  compute  Kendall  "S"  statistics  for 
observations  falling  in  either  the  stability  region  or  the  instability  region  (Urban,  I994a:Ch 
3, 16;  Urban,  1993c:8-l  1).  Kendall  Trend  Detection  is  used  to  determine  the  likelihood 
or  probability  that  a  trend  exists  in  a  series  of  demand  observations  observed  during  some 
time  period.  The  Kendall  "S"  statistics  is  by  design  robust,  invariant  procedures,  which 
together,  provide  an  integrated  capability  to  make  realistic  and  statistically  sound 


2-23 


inferences  about  the  presence  of  a  trend  and  its  expected  impact  or  affect  on  the  average 
or  forecast  demand  (Urban,  1994a:Ch  3, 16;  Urban,  I993c;8-l  1). 

If  it  detects  a  trend,  SDF  will  use  the  Sen  Median  forecast  technique  or  a  four 
quarter  moving  average  technique  to  adjust  the  forecast  to  the  demand  pattern  and  then 
return  to  the  original  forecasting  technique.  The  adjustment  procedure  is  known  as  a  step 
increase  or  step  decrease  forecast 


Figure  2-5.  Demand  Trending 


Bias  Te.sts.  For  stable  non-trending  items,  the  forecasting  system  performs 
a  series  of  tests  to  ensure  that  the  observations  have  not  drifted  away  from  the  mean 
forecast  The  Bias  tests  are  the  Runs  Test,  the  Cumulative  Quantity  Difference  Test  or 
the  Cumulative  Percentage  Difference  Test  and  the  Student  Confidence  Interval  Test 
(Urban,  1994a:  Ch  3, 16).  These  tests  are  conducted  only  if  the  Filters  test  has 
categorized  the  current  forecast  as  being  stable.  It  is  not  conducted  if  the  Filters  test 
caused  the  system  to  reforecast  a  new  forecast  (Wehde,  1994b;6). 
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The  bias  tests  are  conducted  because  it  is  possible  for  demand  observations  to  be 
stable  but  still  suggest  that  demand  should  be  reforecast  (Wehde,  1994b:6).  For  example, 
a  series  of  stable  demand  observations  that  fall  consecutively  above  the  mean  suggests  that 
the  forecast  is  too  low.  SDF’s  Bias  tests  are  conducted  using  an  average  quarterly  demand 
which  is  computed  over  a  one  or  two  year  period  (Wehde,  1994b;6). 

Runs  Test.  If  the  current  forecast  is  a  good  estimate  of  future 
demand,  then  it  is  expected  that  future  demand  observations  will  be  uniformly  distributed 
above  and  below  the  current  forecast  serving  as  the  mean.  In  the  Runs  Test,  for  every 
time  period,  SDF  compares  the  average  quarterly  demand  (DemCur)  to  the  current 
demand  forecast  (DemFor)  (Wehde,  1994b:6).  If  demand  observations  are  consecutively 
recurring  above  or  below  the  mean,  then  the  Runs  Test  is  failed.  If  the  Runs  Test  fails, 
demand  is  reforecast  (Wehde,  1994b:4). 


Figure  2-6  illustrates  such  a  situation.  The  length  of  a  run  (X)  is  compared  to  a 
parameter  value  set  by  the  item  manager.  It  is  reset  to  zero  when: 
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1.  DeraCur  equals  DeraFor. 

2.  DeraCur  changes  from  being  less  than  DeraFor  to  being  greater  or  vice  versa. 

3.  Demand  is  reforecast. 

In  the  Runs  Test ,  items  are  also  classified  as  low,  medium  and  high  dollar  value 
items.  The  constant  value  parameter  to  which  the  length  of  run  is  compared  is  set 
according  to  the  dollar  value  of  the  item.  A  high  dollar  value  item  may  have  a  length  of 
run  set  to  four  [4]  and  a  low  dollar  value  item  may  have  a  length  of  run  set  to  ten  [  10]. 
Figure  2-6  illustrates  a  situation  where  the  length  of  run  is  seven  [7]. 

Cumulative  Error  Tests.  There  are  two  cumulative  error  tests:  the 
Cumulative  Quantity  Difference  Test  and  the  Cumulative  Percentage  Difference  Test.  The 
Cumulative  Quantity  Difference  Test  is  used  for  low  demand  items.  This  test  is  conducted 
only  if  the  demand  originally  fell  in  the  Stability  Region  and  then  passed  the  Runs  Test . 
During  this  test,  SDF  takes  the  absolute  difference  between  the  current  observation  and 
the  current  forecast.  A  running  total  of  the  errors  is  kept.  When  the  cumulative  sum  of 
the  forecast  error  grows  to  be  larger  than  some  set  parameter,  then  demand  is  reforecasted 
(Urban,  1994a:Ch  1, 1;  Wehde,  1994b:  8).  The  Cumulative  Quantity  Difference  equation 
is  shown  below. 

Cumulative  Quantity  Difference  =  S I  Obs  (t)  -  For  (t)l  (7) 

where 

Obs(t)  =  Observation  at  period  t 

For  (t)  =  Forecast  for  period  t 

Tne  Cumulative  Percentage  Difference  Test  is  the  same  as  the  Cumulative 
Quantity  Difference  Test  but  it  is  used  for  high  demand  items.  This  test  is  conducted  only 
if  the  demand  observation  originally  fell  in  the  Stability  Region  and  then  passed  the  Runs 
Test .  With  this  test,  SDF  takes  the  absolute  percentage  difference  between  the  current 
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observation  and  the  current  forecast.  A  running  total  of  the  percentage  errors  is  kept. 
When  the  cumulative  sura  of  the  forecast  error  grows  to  be  larger  than  some  set 
parameter,  then  demand  is  reforecast  (Urban,  1994a:App  I,  2;  Wehde,  1994b:8).  The 
Cumulative  Percentage  Difference  is  shown  below. 

Cumulative  Percentage  Difference  =  S  {I  Obs  (t)  -  For  (t)l  /  For(t) }  (8) 

where 

Obs(t)  =  Observation  at  period  t 
For  (t)  =  Forecast  for  period  t 

Student  Confidence  Interval  Te.st.  A  confidence  interval  is 
computed  using  a  Student-t  test.  The  mean  current  forecast  is  used  to  compute  the 
confidence  interval.  If  the  average  quarterly  demand  is  outside  of  the  confidence  interval, 
the  test  fails  and  a  new  demand  forecast  is  computed  (Urban,  1994a:App  I,  2). 

Module  4:  Quantity  Forecasts.  In  this  module,  SDF  performs  quantity  forecasts 
for  different  variables.  These  variables  will  help  to  compute  the  net  procurement  lead-time 
demand  and  the  net  demand  during  repair  tum-around-time  (Urban,  1993c;  18;  Urban 
1994b).  These  variables  are: 

1.  Demand  Forecast 

2.  Program  Related  Values 

3.  System  Forecasts 

4.  System  Requisition  Average 

5.  Regenerations  Forecast 

6.  Activity  Demands  and  Requisition  Average  Forecast 

7.  Fixed  Allowance  Demand,  Repair  Completion,  and  BCM  Forecasting  (System) 
Module  5:  Procurement  Problem  Variable  Forecast.  The  purpo.se  of  this  module  is 

to  aggregate  all  variables  computed  in  the  previous  modules  to  compute  the  net  demand 
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during  lead-time  and  the  net  demand  during  repair  turn  around  time  (Urban,  iy93c:20; 
Uitan,  1994b). 

Chapter  Summary 

This  literature  review  presented  descriptions  of  the  data  pattern  components,  the 
current  Air  Force  Recoverable  Consumption  Item  Requirements  System  (D041) 
forecasting  approach,  the  future  Air  Force  Requirements  Data  Bank  System  forecasting 
approach  and  the  Navy's  Statistical  Demand  Forecasting  System. 

Data  can  be  decomposed  into  components  known  as  trend,  cycle,  seasonality,  and 
randomness.  The  current  Air  Force  forecasting  approach  uses  an  Eight  Quarter  Moving 
Average  as  a  forecasting  technique  to  predict  future  spare  part  requirements  for  weapon 
systems.  The  future  Air  Force  forecasting  approach  contains  three  different  forecasting 
techniques:  Four  to  Eight  Quarter  Moving  Average  technique.  Double  Exponential 
Smoothing  technique,  and  Predictive  Logistics  known  as  the  PRELOG  technique. 

The  Statistical  Demand  Forecasting  System  was  developed  by  the  Navy  Aviation 
Supply  Office  to  forecast  its  recoverable  and  consumable  requirements  for  program  and 
non-program  related  items.  The  SDF  system  contains  statistical  process  control  charts  to 
detect  demand  instability  and  is  designed  to  improve  forecast  accuracy  and  to  reduce  level 
instability.  SDF  also  contains  several  forecasting  techniques  which  include  Moving 
Average,  Exponential  Smoothing,  Linear  Regres.sion,  Dampened.  Non-Parametric.  and 
Composite  Forecasting  techniques.  The  next  chapter  discusses  how  the  actual  research 
was  conducted.  It  also  describes  how  the  data  were  obtained  and  analyzed. 
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III.  Methodology 


IntfQdugton 

The  purpose  of  this  study  is  to  provide  a  comparison  of  the  performance  and 
accuracy  of  the  Navy  forecasting  system  (SDF)  relative  to  the  Air  Force  forecasting 
system  (RDB)  in  an  Air  Force  environment 

This  chapter  describes  the  type  of  research  design,  the  research  questions,  the  null 
hypotheses,  and  the  instruments  pursued  to  do  the  comparison  analysis.  The  analytical 
approach,  population  size,  sample  size,  data  collection,  and  limitations  used  to  perform  the 
study  are  also  discussed.  Finally,  this  chapter  highlights  the  actual  research  plan. 

Typg  of  Resgarch  Dgsisn 

A  research  design  represents  the  blueprint  for  the  collection,  measurement,  and 
analysis  of  data.  It  is  a  structured  outline  conceived  to  obtain  answers  to  research 
questions  (Emory  and  Cooper,1991: 138).  The  research  design  may  be  viewed  from 
different  perspectives  such  as  the  method  of  data  collection,  the  design  of  the  research,  the 
purpose  of  the  research,  and  the  topical  scope  (Emory  and  Cooper,  199 1:139). 

The  method  of  data  collection  depends  on  whether  the  research  is  observational  or 
survey.  An  observational  research  refers  to  the  study  of  activities  of  a  subject  or  th  * 
nature  of  some  material  without  interacting  with  the  subject  or  material.  The  subject  or 
the  material  is  being  ob.served  (Emoty  and  Cooper,  199 1 : 140).  A  survey  research  refers  to 
the  study  of  responses  obtained  from  questions  asked  to  the  subject  (Emory  and 
Cooper,  199 1 : 140).  This  research  falls  into  the  category  of  an  observational  research.  The 
two  forecasting  systems  are  being  observed  under  different  scenarios  to  determine  which 
system  is  most  appropriate  to  forecast  Air  Force  demand. 
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The  design  of  the  research  depends  on  whether  the  researcher  has  control  over  the 
variables  being  studied.  The  two  types  of  research  designs  are  the  experimental  design 
and  the  ex  post  facto  design.  Experimental  design  is  appropriate  if  the  researcher  has  the 
ability  to  manipulate  the  variables  to  determine  whether  the  variables  affect  other  variables 
(Emory  and  Cooper,199l;  140).  In  the  ex  post  facto  design,  the  investigator  has  no 
control  over  the  variables.  It  is  difficult  to  manipulate  the  variables  because  the  researcher 
can  only  report  what  happened  (Emory  and  Cooper,  199 1: 140).  This  thesis  re.search  deals 
with  an  ex  post  facto  research  design.  The  research  design  measures  and  compares  the 
forecasts  of  the  forecasting  systems. 

The  purpose  of  the  study  depends  on  whether  the  research  is  descriptive  or  cau.sal. 
The  purpose  of  a  descriptive  study  is  to  answer  the  questions:  what,  when,  where  or  how 
much  (Emory  and  Cooper,  199 1:141).  It  deals  with  a  question  or  hypothesis  being 
stipulated  concerning  the  size,  form,  distribution  or  existence  of  a  variable  (Emory  and 
Cooper,  1991: 148).  A  causal  study  deals  with  learning  why  or  how  one  variable  affects 
another.  It  tries  to  explain  the  relationship  that  can  exist  among  variables  (Emory  and 
Cooper, 1 99 1: 141).  This  research  is  a  descriptive  study  and  it  answers  the  following 
question:  What  forecasting  approach  is  most  accurate  to  forecast  Air  Force  demand? 

The  topical  .scope  of  the  research  is  defined  as  the  breadth  and  depth  of  the  study 
(Emory  and  Cooper,  1 99 1 ;  1 39).  The  research  may  repre.sent  a  case  study  or  a  stati.stical 
study.  A  case  study  refers  to  the  analysis  of  a  limited  number  of  events  or  conditions  and 
their  interrelations  (Emory  and  Cooper,199I;  142).  A  .statistical  study  deals  with  capturing 
the  characteristics  of  a  population  by  making  inferences  from  a  sample  of  items.  In 
general  the  hypotheses  te.sted  are  quantitative  (Emory  and  Cooper,1991:142).  This  the.sis 
research  is  a  statistical  study.  It  tries  to  determine  which  forecasting  approach  is  best 
suited  to  forecast  Air  Force  recoverable  items  demands. 
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The  design  of  this  thesis  research  is  described  as  follow:  the  method  of  data 
collection  is  observational;  the  design  of  the  research  is  ex  post  facto;  the  purpose  of  this 
study  is  descriptive;  and  the  topical  scope  of  the  study  is  statistical.  The  implementation 
of  the  research  design  is  described  at  a  later  point  in  this  chapter. 

Rs^sareh  QussUons 

To  evaluate  the  forecasting  systems  and  to  address  forecasting  accuracy  and 
robustness,  the  following  research  questions  are  developed; 

1.  How  does  each  forecasting  system  perform  with  different  time  series  components? 

2.  how  accurate  are  the  forecasts  computed  by  each  forecasting  technique  subject  to 
actual  Air  Force  demand  data? 

3.  What  effects  do  the  forecasts,  computed  by  each  forecasting  approach,  have  on 
aircraft  availability? 

Research  Question  1.  The  first  research  question  is:  How  does  each  forecasting 
system  performs  with  different  data  pattern  components?  The  purpose  of  this  research 
question  is  to  determine  how  well  the  forecasting  systems  react  to  different  times  series 
components.  Times  series  components  can  be  encountered  in  the  demand  data  and  it  is 
important  to  understand  how  well  the  forecasting  systems  will  respond  to  them.  To 
answer  the  research  question,  the  following  investigative  questions  are  developed: 

1.  What  is  the  difference  between  the  RDB  average  forecasting  error  and  the  SDF 
average  forecasting  error  when  a  trending  component  is  present  in  the  data? 

2.  What  is  the  difference  between  the  RDB  average  forecasting  error  and  the  SDF 
average  forecasting  error  when  a  cyclic  component  is  present  in  the  data? 

3.  What  is  the  difference  between  the  RDB  average  forecasting  error  and  the  SDF 
average  forecasting  error  when  a  .seasonal  component  is  present  in  the  data? 


3-3 


4.  What  is  the  difference  between  the  RDB  averagvj  forecasting  error  and  the  SDF 
average  forecasting  error  when  a  random  component  is  present  in  the  data? 

0.  What  is  the  difference  between  the  RDB  average  forecasting  error  and  the  SDF 
average  forecasting  error  when  an  outlier/spike  component  is  present  in  the  data  ’ 

Research  Question  II.  The  second  research  question  is:  How  accurate  are  the 
forecasts  computed  by  each  forecasting  technique  subject  to  actual  Air  Force  demand 
data?  The  main  purpose  of  this  approach  is  to  verify  and  evaluate  how  well  each 
forecasting  approach  performs  when  subject  to  teal  world  data.  To  answer  the  research 
question,  the  following  investigative  questions  are  developed: 

1.  What  are  the  mean,  variance  and  standard  error  of  the  forecasting  errors  ’ 

2.  Are  the  forecasts  responsive  to  actual  observations? 

3.  What  is  the  difference  between  the  RDB  average  forecasting  error  and  the  SDF 
average  forecasting  error? 

Research  Question  PI.  The  third  research  question  is:  What  effects  do  the 
forecasts,  computed  by  each  foreca.sting  approach,  have  on  aircraft  availability?  The 
main  purpose  of  this  approach  is  to  verify  and  evaluate  how  each  forecasting  approach 
affects  the  aircraft  availability  achieved. 

1.  What  is  the  difference  between  the  aircraft  availability  achieved  with  actual  demand 
rates  and  the  aircraft  availability  achieved  with  the  RDB  forecasted  values? 

2.  What  is  the  difference  between  the  aircraft  availability  achieved  with  actual  demand 
rates  and  the  aircraft  availability  goals  achieved  with  the  SDF  forecasted  values? 

Research  Hvpothe.ses 

To  answer  the  research  questions,  null  hypotheses  were  constructed  to  make 
inferences  about  the  forecasting  systems.  This  re.search  hypothesizes  that  the  the  Air 
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Force  Requirements  Data  Bank  system’s  forecasts  are  as  accurate  as  the  Navy  Statistical 
Demand  Forecasting  system's  forecasts. 

To  answer  the  first  research  question,  a  hypothesis  is  developed  for  each  time 
series  components.  Considering  each  data  pattern  component,  the  null  hypothesis  to  be 
tested  is  that  the  RDB  forecasting  error  mean  (p-i)  is  equal  to  the  SDF  forecasting  error 
mean  (1x2)  at  the  90%  confidence  level. 

Ho:  \ii  =  |i2 
Ha:  Hi  H2 

The  test  is  a  two-tailed  test  and  tries  to  determine  whether  there  is  a  significant  difference 
between  the  forecasting  errors  generated  by  the  RDB  system  and  the  SDF  system.  The 
90%  confidence  level  was  selected  because  if  there  is  no  significant  difference  at  90%, 
there  won't  be  a  significant  difference  at  95%  either. 

To  answer  the  second  research  question,  the  null  hypothesis  to  be  tested  is  that  the 
RDB  forecasting  error  mean  (Hi)  is  equal  to  the  SDF  forecasting  mean  (1x2)  at  the  90% 
confidence  level. 

Ho:  Hi  =  H2 
Ha:Hi5^H2 

The  test  is  a  two-tailed  test  and  tries  to  determine  whether  there  is  a  significant  difference 
between  the  forecasting  errors  generated  by  the  RDB  system  and  the  SDF  system.  The 
90%  confidence  level  was  selected  because  if  there  is  no  significant  difference  at  90%. 
there  won't  be  a  significant  difference  at  95%  either. 

To  answer  the  third  research  question,  the  evaluation  of  aircraft  availability,  the 
null  hypothesis  to  be  tested  is  that  the  average  aircraft  availability  (Hi)  achieved  with  the 
RDB  forecasting  approach  is  equal  to  the  average  aircraft  availability  (H2)  achieved  with 
the  SDF  forecasting  approach  at  the  90%  confidence  level. 

Ho:  Hi  =  H2 
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Ha:  \ii  ^2 

The  test  is  a  two-tailed  test  and  tries  to  deterraine  whether  there  is  a  significant  difference 
between  the  forecasting  errors  generated  by  the  RDB  system  and  the  SDF  system.  The 
90%  confidence  level  was  selected  because  if  there  is  no  significant  difference  at  90%, 
there  won't  be  a  significant  difference  at  95%  either. 

Since  the  analysis  involved  two  populations,  a  Paired  Difference  Test  is  used  to 
test  each  of  the  null  hypotheses  mentioned  above. 

Instmmgnts 

The  forecasts  for  the  Air  Force  RDB  system  are  computed  using  a  simulation 
model  of  the  RDB  Forecasting  approach.  The  simulation  program  uses  FORTRAN 
coding  and  is  shown  in  Appendix  C.  The  forecasts  associated  with  the  SDF  system  are 
computed  using  the  actual  Navy's  SDF  System. 

To  compare  the  SDF  forecasting  performance  to  the  RDB  forecasting 
performance,  three  instruments  are  used:  forecasting  measurement  errors,  Paired 
Difference  Test,  and  Aircraft  Sustainability  Model. 

Forecasting  Error  Measurements.  The  puipose  of  this  instrument  is  to  compare 
the  forecasts  to  the  actual  observations.  The  accuracy  of  forecasting  methods  is 
frequently  judged  by  comparing  the  original  observations  to  the  forecast  of  these 
observations.  Several  methods  have  been  devised  to  summarize  the  errors  generated  by  a 
particular  forecasting  technique  (Hanke,  1992:1 12).  Most  of  these  measures  involve 
averaging  some  function  of  the  difference  between  an  actual  observation  and  its  forecast 
value.  These  differences  between  observed  values  and  forecast  values  are  often  referred 
to  as  residuals  (Hanke,  1992: 1 13). 
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Four  methods  used  to  evaluate  the  forecasting  errors  associated  with  each 
forecasting  technique  are:  Mean  Absolute  Deviation  (MAD),  Mean  Square  Error  (MSE), 


Mean  Absolute  Percentage  Error  (MAPE),  and  Mean  Percentage  Error  (MPE). 

Mean  Absolute  Deviation.  The  Mean  Absolute  Deviation  (MAD) 
measures  forecast  accuracy  by  averaging  the  magnitudes  of  the  forecast  error.  MAD  is 
most  useful  when  the  analyst  wants  to  measure  forecast  error  in  the  same  units  as  the 
original  series  (Hanke,  1992: 1 13).  The  MAD  formula  is  presented  in  Equation  9  (Hanke, 
1992:114). 

MAD  =  'a  YfFtl  (9) 


Yt  =  Actual  value  at  time  t 
Ft  =  Forecast  at  time  t 
n  =  number  of  periods 

Mean  Square  Error.  The  Mean  Square  Error  (MSE)  is  an  alternative 

method  for  evaluating  a  forecasting  technique.  Each  residual  is  squared.  This  approach 

provides  a  penalty  for  large  forecasting  errors.  Equation  10  demonstrates  the  Mean 

Square  Error  formula  (Hanke,  1992:1 14). 

MSE  =  I  (  Yt  -  Ft  (10) 

n 

where 

Yt  =  Actual  value  at  time  t 
Ft  =  Forecast  at  time  t 
n  =  number  of  periods 

Mean  Absolute  Percentage  Error.  Sometimes  it  is  more  useful  to  compute 
the  forecasting  errors  in  terms  of  percentages  rather  than  amounts  (Hanke,  1992: 1 14). 

The  Mean  Absolute  Percentage  Error  (MAPE)  provides  an  indication  of  how  large  the 
forecast  errors  are  in  comparison  to  the  actual  values.  In  the  MAPE  equation,  the  residual 
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is  divided  by  the  actual  demand  to  obtain  a  percentage.  Sometimes,  for  different  items, 
the  true  quarterly  demand  is  zero.  If  the  true  demand  is  zero,  then  the  MAPE  becomes 
undefined.  For  this  reason,  if  the  true  demand  is  zero,  the  demand  observation  should  be 
ignored  (Sherbrooke,  1987:5).  Equation  11  demonstrates  the  Mean  Absolute  Percentage 
Error  formula  (Hanke,  1992: 1 14). 

MAPE  =  I(IYt-Ftl/Pt  1  (11) 


Yj  =  Actual  value  at  time  t 
Ft  =  Forecast  at  time  t 
Pt=Yt 

n  =  number  of  periods 

Mean  Percentage  Error.  Sometimes  it  is  necessary  to  determine  whether  a 
forecasting  method  is  biased  (consistently  forecasting  low  or  high).  The  Mean  Percentage 
Error  (MPE)  is  used  in  this  case  (Hanke,  1992: 1 14).  For  the  purpose  of  this  research,  the 
MPE  equation  was  slightly  modified.  In  the  MPE  equation,  the  residual  is  divided  by  the 
actual  demand  to  obtain  a  percentage.  If  the  true  demand  is  zero,  then  the  MPE  becomes 
undefined.  For  this  reason,  if  the  true  demand  is  zero,  the  demand  observation  should  be 
ignored  (Sherbrooke,  1987:5).  Equation  12  demonstrates  the  Mean  Percentage  Error 
formula  (Hanke,  1992: 1 14). 

MPE  =  lHYt-Ft)/Pt  1  (12) 


Yj  =  Actual  value  at  time  t 
Ft  =  Forecast  at  time  t 
Pt  =  Yt 

n  =  number  of  periods 
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Student  Paired  Difference  Test.  The  purpose  of  the  Student  Paired  Difference 
Test  is  to  compare  the  difference  between  two  population  means  (McClave  and  Benson, 
1991:421).  The  assumptions  of  the  test  are  (McClave  and  Benson,  I99l;424); 

1.  The  relative  frequency  distribution  of  the  population  of  differences  is  normal. 

2.  The  differences  are  randomly  selected  from  the  population  of  differences. 

Table  3-1  illustrates  the  Paired  Difference  Test  (McClave  and  Benson,  1991:424). 

Aircraft  Sustainability  Model.  Aircraft  availability  is  defined  as  the  percentage  of 
aircraft  which  are  available,  or  fully  mission  capable.  If  an  aircraft  is  not  missing  a 
reparable  component  due  to  repair,  it  is  considered  available  (O'Malley,  1983:Ch  1,  1 ). 
Inventory  stockage  models,  used  to  optimize  the  aircraft  availability,  are:  METRIC,  Mod- 
METRIC,  Aircraft  Availability  Model,  Vari-METRIC,  Dyna-METRIC  and  Aircraft 


Sustainability  Model  (Pohlen,  1994:4-5). 

Table  3- 

1.  Paired  Difference  Test 

Two  Tailed  Test 

Hypotheses 

Ho:  |a  1-112  =  0 

Ha:  m-ii2  5*0 

Test  Statistic 

t  =  (itO'^O)  !  {S^-Square  Rooting)) 

where  liD=  Sample  mean  of  differences 

Sd=  Sample  standard  deviation  of 
differences 

nD=  Number  of  differences 

Rejection  Region 

t  <  -  t(x/2  or  t  >  t(x/2 
where  IqJ2  (no-Odf 

For  the  purpose  of  this  study,  the  Aircraft  Sustainability  Model  was  selected  to 
measure  the  aircraft  availability  achieved.  The  reason  for  selecting  this  model  versus  the 
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other  models  is  because  of  its  simplicity.  This  model  is  easier  to  use  than  the  others  and 
can  run  quickly  on  a  micro-computer  (Klinger,  1994:48). 

The  Aircraft  Sustainability  Model  is  a  "two-indenture,  two-echelon  requirements 
model  for  a  single  weapon  system."  (Slay  and  King,  1987:Ch  2, 2).  Given  the  stock  levels 
for  the  parts  being  modeled  over  a  period  of  time,  it  projects  aircraft  availability  rates. 

The  user  can  also  specify  the  desired  aircraft  availability  goals  and  funding  constraint 
(Klinger,  1994:42-43).  To  compute  the  aircraft  availability  rate,  the  expected  backorders 
must  first  be  calculated.  Backorders  are  defined  as  unfilled  demands.  They  are  the 
number  of  holes  in  an  aircraft,  or  the  number  of  missing  items  on  an  aircraft  (Klinger, 
1994:13).  Using  a  pure  Poisson  distribution,  the  expected  backorders  are  computed  as 
follows  (Sherbrooke,  1992:25): 

oo 

EBO(Si)  =  I  (x-S)  p(xlXT)  ( 1 3) 

XasS+l 


where 

S  =  stock  level 
X  =  S+1  to  oo 

XT  =  mean  number  of  units  in  resupply 

Using  the  expected  backorders,  the  aircraft  availability  is  then  computed  as  follows 
(Sherbrooke,  1992:25): 


where 


1 

A=  100  n  { 1  -  EBOi(si)/(NZi)}Z> 

i=l 


(14) 


N  =  the  number  of  aircraft 
Zj  =  quantity  per  application 
EBOi(si)  =  expected  backorders 
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The  research  assumptions  used  with  the  Aircraft  Sustainability  model  are  as 
follows; 

1.  An  aircraft  is  down  upon  failure  of  an  LRU  for  which  no  spare  is  available 
(Klinger,  1994:43). 

2.  If  a  part  cannot  be  repaired  at  the  base,  it  is  shipped  to  the  depot  for  possible 
repair  (Klinger,  1994:43). 

3.  A  replenishment  from  the  depot  is  requested  immediately.  Both  the  base  and 
the  depot  operate  under  (s-1,  s)  inventory  policy  (Klinger,  1994:43). 

4.  All  failures  occur  at  the  base  (Klinger,  1994:43). 

5.  For  all  items,  the  quantity  per  aircraft  is  equal  to  one. 

6.  There  are  no  SRUs. 

7.  All  items  belong  to  a  fictitious  weapon  system. 

8.  If  a  part  is  condemned,  a  replenishment  from  an  outside  source  of  supply  is 
requested  (Slay  and  King,  1987;Ch  2, 2). 

Analytical  Approaches 

To  support  the  research  design,  and  to  answer  the  research  questions  cited  in 
Chapter  One,  three  analytical  approaches  are  used  to  evaluate  and  compare  the  Air  Force 
forecasting  method  (RDB)  to  the  Navy  forecasting  method  (SDF): 

Approach  One.  The  first  approach  measures  the  performance  of  the  two 
forecasting  systems,  subject  to  the  influence  of  different  time  series  components,  in  terms 
of  accuracy  and  stability.  The  main  purpose  of  this  approach  is  to  verify  and  evaluate  how 
well  each  forecasting  approach  reacts  when  subject  to  different  time  series  components.  A 
FORTRAN  program  was  built  to  generate  each  type  of  data  pattern.  The  code  for  the 
FORTRAN  pro2,ram  is  contained  in  Appendix  A.  Forecasting  measurement  errors  are 
used  to  measure  the  stability  and  accuracy  of  the  forecasts.  Separate  scenarios  are 
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constructed  for  each  of  the  time  series  components:  trend,  cycle,  seasonal,  random  and 
outlier.  Under  each  scenario,  forecasting  measurement  errors  (MAD,  MSE,  MAPE  and 
MPE)  are  computed  to  measure  the  performance  of  each  forecasting  system  (SDF  versus 
RDB).  A  Paired  Difference  Test  at  the  90%  confidence  level  is  conducted  for  each 
scenario  and  for  each  type  of  forecasting  error.  Table  3-2  illustrates  the  design  of  each 
scenario.  Considering  each  data  pattern  component,  the  null  hypothesis  to  be  tested  is 
that  the  RDB  forecasting  error  mean  (p.j)  is  equal  to  the  SDF  forecasting  mean  (^2)  at 
the  90%  confidence  level. 

Ho;  (Jii  =  (I2  •  forecasting  error  mean  =  SDF  forecasting  error  mean 

Ha:  p.}  1x2  ;  RDB  forecasting  error  mean  *  SDF  forecasting  error  mean 


Table  3-2.  Design  of  Analytical  Approach  One 


IISMnMmMt' 

MAD 

Ho:U|-U2=0 

Paired 

Difference 

Test 

Ho:4i-42=0 

Ha;4i-42?*0 

Faired 

Difference 

Test 

Ho:4i-42=0 

Ha:4i-42^ 

Paired 

Difference 

Test 

Ho-.4i-42=0 
Ha4i -425*0 

Paired 

Difference 

Test 

Ho:4  1-42=0 
Ha-41 -425*0 
Paired 
Difference 

Test 

MSE 

Ho;hj-H2=9 

Ha;ui-U2^ 

Paired 

Difference 

Test 

Ho:4i-42=0 
Ha:4i -425*0 
Paired 
Difference 
Test 

Ho:4  1-42=0 
Ha:4i-42^ 
Paired 
Difference 

Test 

Ho:4i-42=0 
Ha;4i -425*0 
Paired 
Difference 

Test 

Ho:4i-42=0 
Ha4i -425*0 

Paired 

Difference 

Test 

MAPE 

Ho:u  1-42=0 
Ha:4]-42’^ 
Paired 
Difference 

Test 

Ho;4i-42=0 

Ha:4i-42’^ 

Paired 

Difference 

Test 

Ho;4i-42=0 
Ha-41 -425>^) 
Paired 
Difference 

Test 

Ho:4  1-42=0 
Ha4 1-425*0 

Paired 

Difference 

Test 

Ho:4  1-42=0 
Ha4i -425*0 
Paired 
Difference 

Test 

MPE 

Ho:4i-42=0 
Ha;4 1-425*0 

Paired 

Difference 

Test 

Ho:4  1-42=0 

Ha-4 1*425*0 

Paired 

Difference 

Test 

H0-.4 1-42=0 
Ha:4 1-425*0 
Paired 
Difference 

Test 

Ho:4i  '1^2=0 
Ha4i -425*0 

Paired 

Difference 

Test 

Ho:4  1*42=0 
Ha-4 1-425*0 
Paired 
Difference 

Test 

1 _ 

Mean  forecasting  error  for  RDB 

■in 

Mean  forecasting  error  for  SDF 
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For  each  test  where  a  significant  difference  exists  between  the  two  forecasting 
error  means,  a  One-Tailed  Paired  Difference  Test  at  the  95%  confidence  level  is 
conducted.  The  null  hypothesis  to  be  tested  is  that  the  RDB  forecasting  error  mean  (iij )  is 
equal  to  the  SDF  forecasting  mean  (p.2)  at  the  95%  confidence  level. 

Ho;  |iii  =  H2  •  forecasting  error  mean  =  SDF  forecasting  error  mean 
Ha:  111  >  |i2  •  forecasting  error  mean  >  SDF  forecasting  error  mean,  or 

Ha:  Hi  <  |i2  •  forecasting  error  mean  <  SDF  forecasting  error  mean 

Approach  Two.  Subject  to  n  ai  .\ir  Force  data,  the  second  approach  measures  the 
performance  of  the  forecasting  techniques  in  terms  of  accuracy  and  stability.  The  main 
purpose  of  this  approach  is  to  verify  and  evaluate  how  well  each  forecasting  approach 
performs  when  subject  to  real  world  data.  Four  years  of  historical  data  iiom  the  Air  Force 
D041  system  was  used  to  feed  both  forecasting  systems.  The  first  three  years  were  used 
to  make  forecasts  for  the  fourth  year.  The  forecasts  were  then  compared  to  the  actual 
demands  occurring  in  the  fourth  year.  This  approach  measured  the  performance  of  the 
forecasting  systems  in  terms  of  accuracy  and  stability  subject  to  the  presence  of  real  Air 
Force  data.  Forecasting  errors  (MAD,  MSE,  MAPE  and  MPE)  were  computed  to 
measure  the  performance  of  each  forecasting  approach  (SDF  versus  RDB).  A  Paired 
Difference  Test  at  the  90%  confidence  level  is  conducted  for  each  forecasting  error.  Table 
3-3  illustrates  the  design  of  Approach  Two.  The  null  hypothesis  to  be  tested  is  that  the 
RDB  forecasting  error  mean  (|ii)  is  equal  to  the  SDF  forecasting  mean  (iio)  at  the  90% 
confidence  level. 

Ho;  Hi  =  H2  •  RDB  forecasting  error  mean  =  SDF  forecasting  error  mean 
Ha;  Hi  H2  •  RDB  forecasting  error  mean  ^  SDF  forecasting  error  mean 


3-13 


Table  3-3.  Design  of  Analytical  i  >roach  Two 


MAD 

Ho:4  1-42=0 

Ha:4i-425^ 

Paired  Difference  Test 

MSE 

Ho:4  1*42=0 

Ha:4i-42^ 

Paired  Difference  Test 

MAPE 

Ho:4  1-42=0 

Ha;4i-42?4) 

Paired  Difference  Test 

MPE 

Ho;4  1*42=0 

Ha;4i-42?^ 

Paired  Difference  Test 

Mean  forecasung  error  for  RDB 


Mean  forecasting  error  for  SDF 


For  each  test  where  a  significant  difference  exists  between  the  two  forecasting 
error  means,  a  One-Tailed  Paired  Difference  Test  at  the  95%  confidence  level  Ls 
conducted.  The  null  hypothesis  to  be  tested  is  that  the  RDB  forecasting  error  mean  (|ti ) 
is  equal  to  the  SDF  forecasting  mean  (^2)  at  the  95%  confidence  level. 

Ho:  41=112:  RDB  forecasting  error  mean  =  SDF  forecasting  error  mean 
Ha:  4i  >  42  :  RDB  forecasting  error  mean  >  SDF  forecasting  error  mean,  or 
Ha:  4i  <  42  :  RDB  forecasting  error  mean  <  SDF  forecasting  error  mean 
Approach  Three.  The  main  purpose  of  this  approach  is  to  verify  and  evaluate  how 
each  forecasting  approach  affects  the  aircraft  availability  achieved.  Accuracy  in  terms  of 
demand  is  important.  However  accuracy  in  terms  of  aircndt  availability  is  even  more 
important  because  the  aircraft  availability  is  the  Air  Force  primary  measure  of  system  level 
performance  (Sherbrooke,  1992:27).  Approach  three  has  five  stages: 

1.  Using  the  RDB  forecasted  demand  rates  and  setting  a  specific  funding  level,  use 
the  Aircraft  Sustainability  Model  to  compute  stock  levels  for  all  items. 
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2.  Using  the  actual  demand  rates  and  the  stock  levels  determined  by  RDB  in  stage 
one,  use  the  Aircraft  Sustainability  Model  to  compute  the  aircraft  availability  percentage. 
The  model  is  constrained  by  a  specific  funding  level.  The  funding  constraint  is  $80,000 
for  times  series  components  and  $700,000  for  the  real  Air  Force  data.  These  funding 
constraints  were  selected  to  give  a  fair  aircraft  availability  for  the  mixed  of  items  found  in 
the  sample  data. 

3.  Using  the  SDF  forecasted  demand  rates  and  setting  a  specific  funding  level,  use 
the  Aircraft  Sustainability  Model  to  compute  stock  levels  for  all  items. 

4.  Using  the  actual  demand  rates  and  the  stock  levels  determined  by  SDF  in  stage 
three,  use  the  Aircraft  Sustainability  Model  to  compute  the  aircraft  availability  percentage. 
The  model  is  constrained  by  a  specific  funding  level.  The  funding  constraint  is  $80,000 
for  times  series  components  and  $700,000  for  the  real  Air  Force  data. 

5.  Compare  the  aircraft  availability  achieved  in  stages  two  and  four  with  a  Paired 
Difference  Test.  The  null  hypothesis  to  be  tested  is  that  the  average  aircraft  availability 
(|il)  achieved  with  the  RDB  forecasting  approach  is  equal  to  the  average  aircraft 
availability  (^2)  achieved  with  the  SDF  forecasting  approach  at  the  90%  confidence 
level. 

Ho:  |i,i  =  ^2  •  average  aircraft  availability  =  SDF  average  aircraft  availability 

Ha:  Hi  ^2  •  ^^B  average  aircraft  availability  5*  SDF  average  aircraft  availability 

The  average  aircraft  availability  achieved  is  computed  over  a  period  of  four 
quarters,  using  the  Aircraft  Sustainability  Model.  This  approach  is  repeated  for  the  time 
series  components'  scenarios  and  the  real  Air  Force  data  scenario.  Table  3-4  illustrates  the 
approach. 
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Table  3-4.  Design  of  An^ytical  Approach  Three 


I.  Compute 

Stock 

Stock 

Stock 

Stock 

Stock 

Stock 

RDB 

Levels 

Levels 

Levels 

Levels 

Levels 

Levels 

Stock  Levels 

RDB 

RDB 

RDB 

RDB 

RDB 

RDB 

II.  Compute 

Average 

Average 

Average 

Average 

Average 

Average 

Aircraft 

Aircraft 

Aircraft 

Aircraft 

Aircraft 

Aircraft 

Aircraft 

Availability 

Availability 

Availability 

Availability 

Availability 

Availability 

Availability 

with  RDB 
Stock  Levels 

(Pl) 

(Pi) 

(PI) 

(PI) 

(PI) 

(PI) 

III.  Compute 

Stock 

Stock 

Stock 

Stock 

Stock 

Stock 

SDF 

Levels 

Levels 

Levels 

Levels 

Levels 

Levels 

Stock  Levels 

SDF 

SDF 

SDF 

SDF 

SDF 

SDF 

rv.  Compute 

Average 

Average 

Average 

Average 

Average 

Average 

Aircraft 

Aircraft 

Aircraft 

Aircraft 

Aircraft 

Aircraft 

Aircraft 

Availability 

Availability 

Availability 

Availability 

Availability 

Availability 

Avmlabiliiy 

with  SDF 
Stock  Levels 

(P2) 

(P2) 

(P2) 

1 

(P2) 

(P2) 

(P2) 

V.  Compare 

Ho:|j,i-|j,2=0 

Ho;m.  1-112=0 

Ho:pi-P2=0 

Ho-.p  1-112=0 

Ho:pi-P2=0 

Ho:pi-P2=0 

Aircraft 

Ha:in-U2’^ 

Ha;p  1-425^ 

Ha;p  1-112’^ 

Ha;pi-ii2’^ 

Ha:pi-P2*0 

Hiupi-P2’^0 

Availability 

Paired 

Paired 

Paired 

Paired 

Paired 

Paired 

Difference 

Difference 

Difference 

Difference 

Difference 

Difference 

Test 

Test 

Test 

Test 

Test 

Test 

For  each  test  where  a  significant  difference  exists  between  the  two  average  aircraft 


availability  means,  a  One-Tailed  Paired  Difference  Test  at  the  90%  confidence  level  is 
conducted.  The  null  hypothesis  to  be  tested  is  that  the  RDB  average  aircraft  availability  ( 
|i,l)  is  equal  to  the  SDF  average  aircraft  availability  (H2)  at  the  95%  confidence  level. 

Ho;  |ii  =  H2  ■  average  aircraft  availability  =  SDF  average  aircraft  availability 
Ha:  p,j  ^  |i2  ;  RDB  average  aircraft  availability  >  SDF  average  aircraft  availability 
or  Ha:  fij  <  |i,2  :  RDB  average  aircraft  availability  <  SDF  average  aircraft  availability 


Population  Size 

This  study  Ls  limited  to  the  forecast  of  reparable  items  only.  As  discussed  in 
Chapter  One,  the  purpose  of  the  Recoverable  Item  Process  in  the  Requirements  Data 
Bank  System  is  to  manage  reparable  spare  parts  (Gitman,  1994).  Although  RDB  will 
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have  the  capability  of  managing  consumable  items  in  the  future,  the  Air  Force  currently 
manages  consumable  items  using  the  Economic  Order  Quantity  Buy  Budget 
Computation  System  (D062)  (Gitman,  1994).  Since  a  comparison  is  made  to  address  Air 
Force  concerns,  this  research  limits  its  analysis  only  to  the  range  of  Air  Force  reparable 
spare  parts.  The  population  size  of  the  reparable  items  in  D041  is  approximately  185,000 
items  (Lucas,  1993).  However,  about  40,000  of  those  reparable  items  are  active  (items 
that  are  used  on  a  regular  base)  (Rexroad,  1993a). 

Sample  Size  and  Data  Collection. 

This  discusses  the  computation  of  sample  sizes  for  actual  Air  Force  demand  data 
and  time  series  components  demand  data.  Equation  15  demonstrates  the  formula  used  to 
compute  the  sample  size  necessary  to  estimate  the  mean  to  within  a  bound,  with  a  90% 
confidence  level  (McClave  and  Benson,  1991:320).  Appendix  B  presents  the  Excel 
Spreadsheet  that  computes  the  sample  sizes. 

n  =  [(Za/2)2(j2]/B2  (15) 

where 

n  =  sample  size 

Zo(/2=  Z- value  at  90%  level  confidence  =  1 .96 
=  Variance  of  the  beginning  sample  size 

B  =  The  bound  within  the  mean 

Sample  Size  for  Air  Force  Data.  The  data  sample  con.sists  of  245  reparable 
items.  Specific  items  and  common  items  are  included  in  the  analysis.  The  secondary 
demand  data  were  gathered  from  the  Recoverable  Consumption  Item  Requirements 
(D041)  System.  The  demand  data  cover  four  years  of  historical  data  and  are  either 
specific  or  common  to  different  weapon  system.s.  The  demand  data  include  information 
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such  as  Base  RTS  (Reparable  This  Station),  Base  NRTS  (Not  Reparable  This  Station), 
Base  Condemnations  and  Flying  Programs. 

Variance-to-Mean  Ratio.  The  presence  of  variability  in  demand  data 
makes  it  impossible  to  forecast  future  demands  without  error  (McClave  and  Benson. 
1991:810).  The  VTMR  (variance-to-mean  ratio)  is  a  measure  of  the  variability,  hence  the 
error  source  of  the  demand  process  (Crawford,  1988:3).  Since  demand  variability  affects 
forecasting  outputs  more  than  demand  mean  does,  the  use  of  the  variance-to-mean  rauo 
becomes  an  important  factor  in  the  computation  of  a  sample  size  for  demand  data 
(Maitland,  1993a).  To  ensure  that  the  sample  size  is  really  representative  of  the 
population  size,  it  is  essential  that  the  variance-to-mean  ratio  distribution  of  the  sample 
size  resembles  the  variance-to-mcan  ratio  .  istribution  of  the  population  size  (Abell.  1994). 
To  illustrate  the  VTMR  distribution  of  the  population  size,  the  VTMR  was  computed 
across  6500  items  of  the  population  size.  The  mean  VTMR  was  2.3626  and  the  median 
was  1.3267  across  the  6500  items.  These  results  were  validated  by  John  B.  Abell  who 
stipulated  that  worldwide  demands  generally  have  a  VTMR  approaching  1 .5  (Abell. 

1994).  Figure  3-1  illustrates  the  VTMR  distribution  of  the  population  size. 

To  select  an  appropriate  sample  size,  a  beginning  or  .starting  .sample  size  of  600 
items  is  first  selected  from  the  population  .size  to  compute  the  mean,  variance,  and 
variance-to-mean  ratio  for  each  item.  The  mean  and  variance  are  computed  by  weighting 
the  demand  by  the  number  of  flying  hours.  The  variance-to-mean  ratio  is  then  computed 
using  equation  16  (Crawford,  1988:3). 

VTMR  =  (the  variance  of  the  number  of  demands  per  unit  time)  (16) 

(the  expected  number  of  demands  per  unit  time) 

The  overall  VTMR  mean  and  overall  VTMR  standard  deviation  of  the  beginning 
sample  .size  are  computed.  Using  the  VTMR  standard  deviation  with  equation  15.  the 
final  Air  Force  .sample  .size  is  computed  within  a  bound,  being  the  VTMR  standard 
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deviation  of  the  population  size.  Equation  IS  demonstrates  the  formula  used  to  compute 
the  sample  size  (McClave  and  Benson,  1991:320).  Appendix  B  presents  the  Excel 
Spreadsheet  that  computes  the  fmal  sample  size. 


Figure  3-1.  Variance-to-Mean  Ratio  of  Recoverable  Items  Population  Size 
To  illustrate  the  VTMR  distribution,  the  VTMR  was  computed  across  the  245 


items  of  the  sample  size.  Figure  3-2  illustrates  the  VTMR  distribution  of  the  sample  size. 


Figure  3-2.  Variance-to-Mean  Ratio  of  Recoverable  Items  Sample  Size 
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Figure  3-1  demonstrates  the  VTMR  of  the  recoverable  items  distribution  of  the 
population  size  and  figure  3-2  illustrates  the  VTMR  of  the  recoverable  items  sample  size. 
Figure  3-1  and  figure  3-2  confirm  that  the  sample  size  is  representative  of  the  population 
size. 

Sample  Sizes  for  Time  Series  Components.  The  sample  size  for  each  time  series 
component's  scenario  consists  of  forty  items.  The  time  series  component  data  are 
generated  by  FORTRAN  programs  shown  in  Appendix  A.  To  determine  the  sample  size 
for  each  time  series  component  (trend,  cycle,  seasonal,  randomness,  and  outlier),  data  is 
first  generated  to  create  a  beginning  sample  size.  The  mean  VTMR  and  standard 
deviation  VTMR  of  the  beginning  sample  size  are  computed  to  determine  the  final  sample 
size  for  each  of  the  time  series  components.  Each  time  series  component  sample  size 
computed  had  a  value  lower  than  forty.  However  to  be  on  the  safe  side,  a  sample  size  of 
forty  was  used.  Appendix  B  presents  the  Excel  Spreadsheet  that  computes  the  time  series 
components  sample  sizes. 

Implementation  of  the  Research  Desian 

To  perform  the  comparison  analysis  between  the  Air  Force  Requirements  Data 
Bank  forecasting  approach  and  the  Navy  Stati.stical  Demand  Forecasting  approach,  the 
implementation  of  the  design  is  divided  into  three  phases.  The  purpose  of  each  phase  is  to 
answer  the  three  research  questions. 

Pha.se  One.  The  purpo.se  of  this  phase  is  to  answer  the  first  research  question: 

How  does  each  forecasting  system  performs  with  different  time  series  components?  The 
following  steps  are  used  to  answer  the  research  question: 

1 .  build  FORTRAN  programs  that  generate  time  .series  components.  Appendix  A 
demon.strates  the  coding  of  the  program.s. 
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2.  Compute  a  sample  size  for  each  time  series  component  to  do  the  analysis. 
Appendix  B  demonstrates  the  calculation  of  each  sample  size. 

3.  Build  a  FORTRAN  program  that  simulates  the  Requirements  Data  Bank 
forecasting  approach.  Appendix  C  demonstrates  the  coding  of  the  program. 

4.  Use  the  simulation  model  to  analyze  the  demand  data  and  to  compute  forecasts. 

5.  Compare  the  observed  values  to  the  forecasted  values  and  compute  the 
forecasting  error  measurements  (MAD,  iviAPE  &  MPE)  to  evaluate  the  accuracy 
and  the  stability  of  the  Air  Force  RDB  Forecasting  system.  The  RDB  forecasting 
measurement  errors  are  computed  with  the  help  of  the  RDB  simulation  program  shown  in 
appendix  C. 

6.  Use  the  actual  SDF  system  to  analyze  the  demand  data  and  to  compute 
forecasts. 

7.  Compare  the  observed  values  to  the  forecasted  values  and  compute  the 
forecasting  measurement  errors  (MAD,  MSE,  MAPE  «fe  MPE)  to  evaluate  the  accuracy 
and  the  stability  of  the  Statistical  Demand  Forecasting  system.  The  SDF  forecasting 
errors  are  computed  with  the  help  of  a  FORTRAN  program  shown  in  appendix  D. 

8.  Use  a  Paired  Difference  Test  to  test  the  following  hypothesis:  Subject  to  the 
presence  of  each  data  pattern  component,  the  null  hypothesis  to  be  tested  is  that  the  RDB 
forecasting  error  mean  (pj)  is  equal  to  the  SDF  forecasting  error  mean  (^l2)  at  the  90% 
confidence  level. 

Phase  Two.  The  purpose  of  this  phase  is  to  answer  the  second  research  question: 
How  accurate  are  the  forecasts  computed  by  each  forecasting  technique,  subject  to  the 
presence  of  actual  Air  Force  data?  The  following  steps  are  used  to  answer  the  research 
question: 

1.  Compute  the  sample  size  necessary  to  represent  the  Air  Force  demand  data  at 
the  90%  confidence  level.  Appendix  B  demonstrates  the  calculation  of  the  sample  size. 
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2.  Collect  four  years  of  historical  demand  data  from  the  D041  system.  The  items 
selected  are  either  specific  or  common  to  different  weapon  systems.  The  time  period  for 
the  data  is  from  January  1989  to  December  1993.  Appendix  D  illustrates  the  data  formats 
created  to  run  both  the  RDB  system  and  the  SDF  system. 

3.  Use  the  RDB  simulation  model  to  analyze  the  demand  data  and  compute 
forecasts. 

4.  Compare  the  observed  values  to  the  forecasted  values  and  compute  the 
forecasting  error  measurements  (MAD,  MSE,  MAPE  &  MPE),  to  evaluate  the  accuracy 
and  the  stability  of  the  Air  Force  RDB  Forecasting  system.  The  RDB  forecasting  errors 
are  computed  with  the  help  of  the  RDB  simulation  program  shown  in  appendix  C. 

5.  Use  the  actual  SDF  system  to  analyze  the  demand  data  and  to  compute 
forecasts. 

6.  Compare  the  observed  values  to  the  forecasted  values  and  compute  the 
forecasting  measurement  errors  (MAD,  MSE,  MAPE  &  MPE)  to  evaluate  the  accuracy 
and  the  stability  of  the  Statistical  Demand  Forecasting  system.  The  SDF  forecasting 
errors  are  computed  with  the  help  of  a  FORTRAN  program  shown  in  appendix  D. 

7.  Use  a  Paired  Difference  Test  to  test  the  following  hypothesis;  subject  to  the 
presence  of  actual  Air  Force  data,  the  null  hypothesis  to  be  tested  is  that  the  RDB 
forecasting  error  mean  (^j)  la  equal  to  the  SDF  forecasting  error  mean  (|t2)  at  the  90% 
confidence  level. 

Phase  Three.  The  purpose  of  this  phase  is  to  answer  the  third  research  question: 
What  effects  do  the  forecasts,  computed  by  each  forecasting  approach,  have  on  aircraft 
availability?  The  following  steps  are  used  to  answer  the  research  question: 

1.  Using  the  RDB  forecasted  demand  rates  and  setting  a  specific  funding  level,  use 
the  Aircraft  Sustainability  Model  to  compute  stock  levels  for  all  items.  Stock  levels  are 
computed  for  each  time  .series  components'  .scenarios  and  the  Air  Force  item  .sample 
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scenario.  The  funding  level  is  $80,000  for  the  time  series  components  and  $700,000  for 
the  actual  Air  Force  data. 

2.  Using  the  actual  demand  rates  and  the  stock  levels  determined  by  RDB  in  stage 
one,  use  the  Aircraft  Sustainability  Model  to  compute  the  aircraft  availability  percentage. 
The  model  is  constrained  by  a  specific  funding  level.  The  funding  level  is  $80,000  for  the 
time  series  components  and  $700,000  for  the  actual  Air  Force  data. 

3.  Using  the  SDF  forecasted  demand  rates  and  setting  a  specific  funding  level,  use 
the  Aircraft  Sustainability  Model  to  compute  stock  levels  for  all  items.  Stock  levels  are 
computed  for  each  time  series  components’  scenarios  and  the  Air  Force  item  sample 
scenario.  The  funding  level  is  $80,000  for  the  time  series  components  and  $700,000  for 
the  actual  Air  Force  data. 

4.  Using  the  actual  demand  rates  and  the  stock  levels  determined  by  SDF  in  stage 
three,  use  the  Aircraft  Sustainability  Model  to  compute  the  aircraft  availability  percentage. 
The  model  is  constrained  by  a  specific  funding  level.  The  funding  level  is  $80,000  foi  the 
time  series  components  and  $700,000  for  the  actual  Air  Force  data. 

5.  Compare  the  aircraft  availability  achieved  in  stages  two  and  four  with  a  Paired 
Difference  Test.  The  null  hypothesis  to  be  tested  is  that  the  average  aircraft  availability 
(|i|)  achieved  with  the  RDB  forecasting  approach  is  equal  to  the  average  aircraft 
availability  (112)  achieved  with  the  SDF  forecasting  approach  at  the  90%  confidence 
level. 

Chapter  Summary 

This  chapter  discussed  the  approach  used  to  compare  the  Air  Force  forecasting 
sy.stem  to  the  Navy  forecasting  system.  Three  analytical  approaches  are  used: 

1 .  The  first  approach  consists  of  measuring  the  performance  of  the  two 
forecasting  systems,  subject  to  different  time  series  components,  in  terms  of  accuracy  and 
stability. 
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2.  The  second  approach  consists  of  measuring  the  performance  of  the  two 
forecasting  systems,  subject  to  historical  Air  Force  demand  data,  in  terms  of  accuracy  and 
stability. 

3.  The  third  approach  consists  of  measuring  the  effects  of  the  two  foreca.sting 
systems  on  Air  Force  aircraft  availability. 

This  chapter  gives  a  description  on  the  type  of  research  design,  the  research 
questions,  the  null  hypotheses,  and  the  instruments  used  to  do  the  comparison  analysis.  It 
also  presents  the  analytical  approach,  population  size,  sample  size,  data  collection,  and 
limitations  used  to  perform  the  study.  Finally  the  chapter  highlights  and  explains  the 
implementation  of  the  research  plan.  The  next  chapter  presents  the  results  and  analysis  of 
implementing  the  research  methodology. 


This  chapter  presents  the  results  and  analysis  of  this  comparison  research.  The 
chapter  is  separated  into  three  sections.  The  first  section  discusses  the  forecasting 
measurement  errors  associated  with  the  time  series  components.  The  forecasting  errors 
are  computed  for  each  forecasting  system.  The  second  section  discusses  the  forecasting 
measurement  errors  associated  with  actual  Air  Force  data.  The  forecasting  errors  are 
computed  for  each  forecasting  system.  Finally,  the  third  section  presents  the  aircraft 
availability  results  achieved  with  each  forecasting  system. 

Approach  One  -  Time  Series  Components  Results 

This  section  presents  the  results  obtained  to  answer  the  first  research  question: 
How  does  each  forecasting  system  performs  with  different  time  series  comi.  ents?  The 
purpose  of  this  research  question  is  to  determine  how  well  the  forecasting  systems  react  to 
different  times  series  components.  To  answer  the  research  question,  time  .series 
component  data  sets  are  generated.  The  forecasting  error  results  obtained  explain  how  the 
RDB  forecasting  system  and  the  SDF  system  react  to  different  time  .series  components. 
However  the  errors  computed  are  not  repre.sentative  of  how  the  RDB  .system  or  the  SDF 
sy. stem  generally  performs  ~>thre..  world  data.  The  re.sults  demon.strate  that  when  there 
is  a  trending  component  in  the  data,  the  SDF  system  provides  more  accurate  forecasts  at 
95%  level  confidence  than  the  RDB  sy.stem  does.  The  results  also  demonstrate  that  when 
there  are  outliers  in  the  data,  the  SDF  system  generates  more  accurate  forecasts  than  the 
RDB  system.  However  the  results  illustrate  that  with  the  remaining  time  series 
component,  there  is  not  enough  evidence  at  90%  level  confidence  to  show  that  there  is  a 
significant  difference  between  the  SDF  system  and  the  RDB  system. 
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This  section  is  divided  into  three  parts.  The  first  part  presents  the  forecasting 
measurement  errors  obtained  with  the  Requirements  Data  Bank  system  for  each  time 
series  component.  The  second  part  presents  the  forecasting  measurement  errors  obtained 
with  the  Statistical  Demand  Forecasting  system  for  each  time  series  component.  Finally 
the  third  part  provides  the  comparison  findings  between  the  two  forecasting  systems. 

Requirements  Data  Bank  Results.  Table  4- 1  illustrates  the  mean  and  variance  of 
the  forecasting  measurement  errors  for  each  time  series  component  Appendix  F  presents 
an  Excel  spreadsheet  which  demonstrates  the  mean  and  variance  computations. 

Table  4-1.  RDB  Forecasting  Errors  With  Time  Series  Components 
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Trend.  With  a  sample  made  of  trending  component  data,  the  Requirements 
Data  Bank  obtained  a  Mean  Absolute  Deviation  of  13.16  and  a  Mean  Square  Error  of 
216. 17.  This  demonstrates  that  the  forecasting  errors  are  very  stable  since  the  MSE 
approach  provides  very  little  penalty  for  individual  errors.  The  Mean  Percentage  Error  of 
4.33%  demonstrates  that  the  RDB  system  over-estimated  the  trending  component 
demands  by  4.33%.  The  Mean  Absolute  Percentage  Error  demonstrates  that  the  RDB 
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system  creates  an  average  error  of  4.33%.  The  positive  MPE  indicates  that  the  stronger 
trends  in  the  data  set  are  going  upward. 

Seasonal.  With  a  sample  made  of  seasonal  component  data,  the 
Requirements  Data  Bank  obtained  a  Mean  Absolute  Deviation  of  1.59  and  a  Mean  Square 
Error  of  3.96.  This  demonstrates  that  the  forecasting  errors  are  very  stable  since  the  MSE 
^proach  provides  very  little  penalty  for  individual  errors.  The  Mean  Percentage  Error  of 
-0.0065%  demonstrates  that  the  RDB  system  under-estimated  demands  by  0.0065%.  The 
Mean  Absolute  Percentage  Error  demonstrates  dtat  the  RDB  system  provides  an  average 
error  of  0.6021%.  The  small  percentage  error  indicates  that  the  demand  is  large  and  that 
the  errors  are  minor  compared  to  the  actual  demands. 

Cyclical.  With  a  sample  made  of  cyclical  component  data,  the 
Requirements  Data  Bank  obtained  a  Mean  Absolute  Deviation  of  3. 19  and  a  Mean  Square 
Error  of  15,35.  This  demonstrates  that  the  forecasting  errors  are  very  stable  since  the 
MSE  approach  provides  very  little  penalty  for  individual  errors.  The  Mean  Percentage 
Error  of  -1,32%  demonstrates  that  the  RDB  system  under-estimated  the  seasonal  data  set 
demands  by  1,32%.  The  Mean  Absolute  Percentage  Error  demonstrates  that  the  RDB 
system  provides  an  average  error  of  1.32%.  The  small  percentage  error  indicates  that 
demand  is  large  and  that  the  errors  are  minor  compared  to  the  actual  demands. 

Random.  With  a  sample  made  of  random  component  data,  the 
Requirements  Data  Bank  obtained  a  Mean  Absolute  Deviation  of  2.48  and  a  Mean  Square 
Error  of  8.53.  This  demonstrates  that  the  RDB  system  and  the  forecasting  errors  are  very 
stable  since  the  MSE  approach  provides  veiy  little  penalty  for  individual  errors.  The  Mean 
Percentage  Error  of  0.069%  demonstrates  that  the  RDB  system  over-estimated  the 
seasonal  data  set  demands  by  0.069%.  The  Mean  Absolute  Percentage  Error 
demonstrates  that  the  RDB  system  provides  an  average  error  of  0.98%.  The  small 
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percentage  error  indicates  that  demand  is  large  and  that  the  errors  are  minor  compared  to 
the  actual  demands. 


Outlier.  With  a  sample  made  of  data  with  outliers,  the  Requirements  Data 
Bank  obtained  a  Mean  Absolute  Deviation  of  17.95  and  a  Mean  Square  Error  of  915. 12. 
This  demonstrates  that  the  forecasting  errors  are  not  very  stable  since  the  MSE  approach 
provides  a  large  penalty  for  large  individual  errors.  The  Mean  Percentage  Error  of  2.57% 
demonstrates  that  the  RDB  system  over-estimated  the  seasonal  data  set  demands  by 
2.57%.  The  Mean  Absolute  Percentage  Error  demonstrates  that  the  RDB  system  provides 
an  average  error  of  5.27%. 


Statistical  Demand  Forecasting  Re.sults.  Table  4-2  illustrates  the  mean  and 
variance  of  the  forecasting  measurement  errors  for  each  time  series  component  Appendix 
F  presents  an  Excel  spreadsheet  which  demonstrates  the  mean  and  variance  computations. 
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2.41% 

-0.0036% 

-1.35% 

0.036% 

4.01% 

Variance  MPE 

1.99% 

0.0003% 

0.72% 

0.598% 

10.99% 
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Observations 

40 

39 

40 

40 

36 

Average  MAPE 

2.41% 

0.6036% 

-1.35% 

0.988% 

4.01% 

Variance  MAPE 

1.99% 

0.1359% 

0.72% 

0.312% 

10.99% 

Trend.  With  a  sample  made  of  trend  component  data,  the  Requirements 
Data  Bank  obtained  a  Mean  Absolute  Deviation  of  7.3 1  and  a  Mean  Square  Error  of 
66.72.  This  demonstrates  that  the  forecasting  errors  are  very  stable  .since  the  MSE 
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approach  provides  very  little  penalty  for  individual  errors.  The  Mean  Percentage  Error  of 
2.41%  demonstrates  that  the  SDF  system  over-estimated  the  trend  data  set  demands  by 
2.41%.  The  Mean  Absolute  Percentage  Error  demonstrates  that  the  SDF  system  provides 
an  average  error  of  2.41%.  The  positive  percentage  error  indicates  the  stronger  trends  in 
the  data  set  are  going  upward. 

Seasonal.  Using  the  seasonal  component  data  set  generated,  the 
Requirements  Data  Bank  obtained  a  Mean  Absolute  Deviation  of  1.60  and  a  Mean  Square 
Error  of  3.96.  This  demonstrates  that  the  forecasting  errors  are  very  stable  since  the  MSE 
approach  provides  very  little  penalty  for  individual  errors.  The  Mean  Percentage  Error  of 
-0.0036%  demonstrates  that  the  SDF  system  under-estimated  the  seasonal  data  set 
demands  by  0.0036%.  The  Mean  Absolute  Percentage  Error  demonstrates  that  the  SDF 
system  provides  an  average  error  of  0.6036%.  The  small  percentage  error  indicates  that 
the  demand  is  large  and  that  the  errors  are  minor  compared  to  the  actual  demands. 

Cyclical.  Using  the  cyclical  component  data  set  generated,  the 
Requirements  Data  Bank  obtained  a  Mean  Ab.solute  Deviation  of  3.3 1  and  a  Mean  Square 
Error  of  17.02.  This  demonstrates  that  the  forecasting  errors  are  very  stable  since  the 
MSE  approach  provides  very  little  penalty  for  individual  errors.  The  Mean  Percentage 
Error  of  -1.35%  demonstrates  that  the  SDF  sy.stem  under-estimated  the  seasonal  data  set 
demands  by  1.35%.  The  Mean  Absolute  Percentage  Error  demonstrates  that  the  SDF 
system  provides  an  average  error  of  1.35%.  The  small  percentage  error  indicates  that 
demand  is  large  and  that  the  errors  are  small  compared  to  the  actual  demands. 

Random.  Using  the  random  component  data  set  generated,  the 
Requirements  Data  Bank  obtained  a  Mean  Absolute  Deviation  of  2.56  and  a  Mean  Square 
Error  of  9.5 1 .  This  demonstrates  that  the  SDF  system  and  the  forecasting  errors  are  very 
stable  since  d\e  MSE  approach  provides  very  little  penalty  for  individual  errors.  The  Mean 
Percentage  Error  of  0.036%  demonstrates  that  the  SDF  system  over-estimated  the 
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seasonal  data  set  demands  by  0.036%.  The  Mean  Absolute  Percentage  Error 
demonstrates  that  the  SDF  system  provides  an  average  error  of  0.98%.  The  small 
percentage  error  indicates  that  demand  is  large  and  that  the  errors  are  minor  compared  to 
the  actual  demands. 

Outlier.  Using  the  outlier  component  data  set  generated,  the  Requirements 
Data  Bank  obtained  a  Mean  Absolute  Deviation  of  14.37  and  a  Mean  Square  Error  of 
897.92.  This  demonstrates  that  the  forecasting  errors  are  not  very  stable  since  the  MSE 
approach  provides  very  large  penalty  for  individual  errors.  The  Mean  Percentage  Error  of 
4.01%  demonstrates  that  the  SDF  system  over-estimated  the  seasonal  data  set  demands  by 
4.01%.  The  Mean  Absolute  Percentage  Error  demonstrates  that  the  SDF  system  provides 
an  average  error  of  4.0 1  %. 

Comparative  Results  of  Approach  One.  The  Comparative  results  demonstrate  that 
when  there  is  a  trending  component  in  the  data,  the  SDF  system  gives  a  more  accurate 
forecast  than  the  RDB  system  does  at  95%  level  confidence.  The  results  al.so  demonstrate 
that  when  there  are  outliers  in  the  data,  the  SDF  system  gives  a  more  accurate  forecast 
than  the  RDB  system  does  at  95%  level  confidence.  However  the  results  show  that  for 
the  remaining  time  series  components,  there  is  not  enough  evidence  at  90%  level 
confidence  to  present  a  significant  difference  in  terms  of  accuracy  between  the  SDF 
.sy.stem  and  the  RDB  sy.stem. 

Trend.  Table  4-3  illustrates  the  results  obtained  with  the  paired  difference 
test  when  the  forecasts  were  made  with  data  containing  a  trending  component.  Appendix 
F  demonstrates  the  results  of  the  paired  difference  test  at  a  higher  level  of  detail.  The 
results  demonstrate  that  there  is  enough  evidence  at  90%  level  confidence  (two-tailed  test) 
and  at  95%  level  confidence  (one-tailed  test)  that  when  there  is  a  trending  component  in 
the  data,  the  SDF  system  gives  a  more  accurate  forecast  than  the  RDB  system  does.  This 
demonstrates  that  the  RDB  system  is  more  .stable  when  a  trending  component  is  found  in 
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demand  observations.  It  also  demonstrates  that  the  SDF  system  is  more  responsive  than 
the  RDB  system.  The  reason  for  this  is  that  the  SDF  system  uses  a  four  quarter  moving 
average  technique  to  make  forecasts  when  a  trend  exists  in  the  data.  Therefore  it  is  more 
responsive  to  a  trending  component. 


Table  4-3.  Trend  Paired  Difference  Test 


1 

MAD 

Ho:ui-U2=0 

Ha:ui-U2^ 

13.16 

7.31 

4.8749 

1.6450 

1.6450 

Enough 
Evidence  to 
Reject  Ho 

MSE 

Ho:pi-P2=0 

Ha;ui-U2’^ 

216.17 

66.72 

4.8247 

1.6450 

1.6450 

Enough 
Evidence  to 
Reject  Ho 

MPE 

Ho:pi-U2=0 

Ha:m-M.2^ 

4.33% 

2.41% 

4.1891 

1.6450 

1.6450 

Enough 
Evidence  to 
Reject  Ho 

MAPE 

Ho:pi-P2=0 

Ha:|ii-U2’^ 

4.33% 

2.41% 

4.1891 

1.6450 

1.6450 

Enough 
Evidence  to 
Reject  Ho 

Seasonal.  Table  4-4  illustrates  the  results  obtained  with  the  paired 
difference  test  when  the  forecasts  were  made  with  data  containing  a  seasonal  component 
Appendix  F  demonstrates  the  results  of  the  paired  difference  test  at  a  higher  level  of  detail. 


The  results  demonstrate  that  there  is  not  enough  evidence  at  90%  level  confidence  to 
show  that  there  is  a  significant  difference  in  the  level  of  accuracy  provided  by  each 


Table  4-4.  Seasonal  Paired  Difference  Test 


I#' 


MAD 

Ho:m-U2=0 

Ha:m-P2’^ 

1.59 

1.60 

-0.0453 

1.6450 

1.6450 

Not  enough 
evidence  to 
Reject  Ho 

MSE 

Ho:m-U2=0 

Ha:m-U2’^ 

3.96 

3.96 

-0.0022 

1.6450 

1.6450 

Not  enough 
evidence  to 
Reject  Ho 

MPE 

Ho:ni-P2=0 

Ha;ui-H2’^ 

-0.006% 

-0.004% 

-0.9210 

1.6450 

1.6450 

Not  enough 
evidence  to 
Reject  Ho 

MAPE 

Ho:m-U2=0 

Ha:U|-M.2^ 

0.602% 

0.603% 

-0.0176 

1.6450 

1.(450 

Not  enough 
evidence  to 
Reject  Ho 

forecasting  system.  In  other  words,  the  SDF  system  and  the  RDB  system  provide 
approjumately  the  same  level  of  accuracy,  when  seasonal  component  demand  observations 
exist  in  the  data  set 

Cyclical.  Table  4-5  illustrates  the  results  obtained  with  the  paired 
difference  test  when  the  forecasts  were  made  with  data  containing  a  cyclical  component 
Appendix  F  demonstrates  the  results  of  the  paired  difference  test  at  a  higher  level  of  detail. 
The  results  demonstrate  that  there  is  not  enough  evidence  at  90%  level  confidence  to 
show  that  there  is  a  significant  difference  in  the  level  of  accuracy  provided  by  each 
forecasting  system.  In  other  words,  the  SDF  system  and  the  RDB  system  provide 
approximately  the  same  level  of  accuracy,  when  cyclical  component  demand  observations 
exist  in  the  data  set. 


Table  4-5.  Cyclical  Paired  Difference  Test 


3 

Otrn-im 

MAD 

Ho:ui-U2=0 

3.19 

3.31 

-0.4046 

1.6450 

1.6450 

Not  enough 
evidence  to 
Reject  Ho 

MSE 

15.3C 

17.02 

-0.5589 

1.6450 

1.6450 

Not  enough 
evidence  to 
Reject  Ho 

MPE 

Ho:ui-U2=0 

Ha;4 1-425*0 

-1.32% 

-1.35% 

-0.2213 

1.6450 

1.6450 

Not  enough 
evidence  to 
Reject  Ho 

MAPE 

Ho:4  1*42=0 
Ha:4i-425^ 

1.32% 

1.35% 

-0.2213 

1.6450 

1.6450 

Not  enough 
evidence  to 
Reject  Ho 

Random.  Table  4-6  illustrates  the  results  obtained  with  the  paired 


difference  test  when  the  forecasts  were  made  with  data  containing  a  random  component. 
Appendix  F  demonstrates  the  results  of  the  paired  difference  test  at  a  higher  level  of  detail. 
The  results  demonstrate  that  there  is  not  enough  evidence  at  90%  level  confidence  to 
show  that  there  is  a  significant  difference  in  the  level  of  accuracy  provided  by  each 


forecasting  technique.  In  other  words,  the  SDF  system  and  the  RDB  system  provide 
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approximately  the  same  level  of  accuracy,  when  random  component  demand  observations 
exist  in  the  data  set. 


Table  4-6.  Random  Paired  Difference  Test 


hfem 

sm- 

Tw.>.TaU 

MAD 

Ho:ui-|i2=0 

2.48 

2.56 

-0.4052 

1.6450 

1.6450 

Not  enough 
evidence  to 
Reject  Ho 

MSE 

Ho:pi-U2=0 

Ha;pi-U2’^ 

8.54 

9.51 

-0.8630 

1.6450 

1.6450 

Not  enough 
evidence  to 
Reject  Ho 

MPE 

Ho:m-P2=0 

Ha;ni-U2’^ 

0.068% 

0.036% 

0.2173 

1.6450 

1.6450 

Not  enough 
evidence  to 
Reject  Ho 

MAPE 

Ho:M,i-|12=0 

Ha;|ii-|i2’^ 

0.99% 

1.01% 

-0.1952 

1.6450 

1.6450 

Not  enough 
evidence  to 
Reject  Ho 

Outlier.  Table  4-7  illustrates  the  results  obtained  with  the  paired  difference 
test  when  the  forecasts  were  made  with  data  containing  outliers.  Appendix  F 
demonstrates  the  results  of  the  paired  difference  test  at  a  higher  level  of  detail.  Table  4-7 
illustrates  that  when  comparing  the  MAD  means,  the  SDF  system  is  more  accurate  at 
level  confidence.  Howe’.  er,  when  comparing  the  MPE  means,  the  paired  difference  test 
demonstrates  that  the  RDB  system  is  more  accurate.  Also,  when  comparing  the  MSE 
means  and  the  MAPE  means,  there  is  not  enough  evidence  to  demonstrate  that  there  is  a 
significant  difference  between  the  error  means. 

To  explain  these  results,  it  is  important  to  understand  that  outliers  usually  create 
large  variances  around  the  forecasting  error  means.  The  paired  difference  test  takes  inu) 
consideration  the  size  of  the  variance.  The  iasignificant  results  of  the  paired  difference  test 
for  the  MAPE  and  the  MSE  can  be  explained  by  the  fact  that  there  are  large  variances 
around  the  MAPE  means  and  the  MSE  means. 

The  results  obtained  with  the  paired  difference  test  for  the  MPE  can  also  be 
explained.  Demand  outliers  in  the  data  .set  were  either  larger  than  the  average  forecast  or 
lower  than  the  average  demand.  The  average  .size  of  forecasting  errors  for  RDB  were 
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larger  than  the  average  size  of  forecasting  errors  in  SDF.  The  direction  of  the  error, 
negative  or  positive,  canceled  each  other  to  create  a  small  MPE.  The  MAPE  is  larger  than 
the  MPE  because  it  takes  the  absolute  percentage  instead  of  the  actual  percentage. 
Therefore  the  MAD  demonstrates  that  there  is  enough  evidence  at  90%  level  confidence 
(two-tailed  test)  and  at  95%  level  confidence  (one-tailed  test)  to  show  that  the  SDF 


system  gives  more  accurate  forecast  than  the  RDB  system.  This  demonstrates  that  the 
SDF  system  is  more  stable  when  outliers  are  found  in  the  observations.  The  reason  for 
this  is  that  the  SDF  system  ignores  outliers  on  the  first  occurrence,  making  it  more  stable. 


Table  4-7.  Outlier  Paired  Difference  Test 


SD?  : 

2.Valw 

Oih>T«U 

R«utls 

MAD 

Ho:pi-P2=0 

17.95 

14.38 

1.8015 

1.6450 

1.6450 

Enough 
evidence  to 
Reject  Ho 

MSE 

Ho;m-n2=0 

y{x\x\-\i2*^ 

915.16 

897.92 

0.1051 

1.6450 

1.6450 

Not  enough 
evidence  to 
Reject  Ho 

MPE 

Ho:p]-P2=0 

Ha:m-H2’^ 

2.57% 

4.004% 

-2.2574 

1.6450 

1.6450 

Enough 
evidence  to 
Reject  Ho 

MAPE 

Ho:pj-p.2=0 

Ha;u|-U2^ 

5.27% 

4.004% 

1.3740 

1.6450 

1.6450 

Not  enough 
evidence  to 
Reject  Ho 

Approach  Two  -  Actual  Air  Force  Data  Results 

This  section  presents  the  results  obtained  to  answer  research  question  two;  How 
accurate  are  the  forecasts  computed  by  each  forecasting  technique  subject  to  actual  Air 
Force  demand  data?  The  main  purpose  of  this  approach  is  to  verify  and  evaluate  how  well 
each  forecasting  system  performs  when  subject  to  real  world  data.  The  results 
demonstrate  that  there  is  not  enough  evidence  at  90%  level  confidence  to  show  that  there 
is  a  significance  difference  in  the  level  of  accuracy  between  the  SDF  system  and  the  RDB 
sy.stem. 
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This  section  is  divided  into  three  parts.  The  first  part  presents  the  forecasting 
raeasurenient  errors  obtained  with  the  Requirements  Data  Bank  system.  The  second  part 
presents  the  forecasting  measurement  errors  obtained  with  the  Statistical  Demand 
Forecasting  system.  Finally  the  third  part  provides  the  comparison  findings  between  the 
two  forecasting  systems. 

Requirements  Data  Bank  Results.  Table  4-8  illustrates  the  mean  and  variance  of 
the  forecasting  measurement  errors  obtained  with  Air  Force  sample  data  set.  Appendix  F 
presents  an  Excel  spreadsheet  report  which  demonstrates  all  the  mean  and  variance 
computations. 


Table  4-8.  RDB  Forecasting  Errors 
With  Air  Force  Data 


Observations 

245 

Average  MAD 

6.88 

Variance  MAD 

141.53 

U' 

m 

Observations 

245 

Average  MSE 

246.75 

Variance  MSE 

1229284.67 

p 

■'  . .  ' 

Observations 

245 

Average  MPE 

-26.39% 

Variance  MPE 

4922.41% 

■■ 

Observations 

245 

Average  MAPE 

61.99% 

Variance  MAPE 

3151.37% 

The  Requirements  Data  Bank  obtained  a  Mean  Absolute  Deviation  of  6.88  and  a 
Mean  Square  Error  of  246.75.  This  demonstrates  that  the  forecasting  errors  are  not  very 
stable  since  the  MSE  approach  provides  a  large  penalty  for  individual  errors.  The  Mean 
Percentage  Error  of  -26.39%  demonstrates  that  the  RDB  system  under-estimated  the 
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seasonal  data  set  demands  by  26.39%.  The  Mean  Absolute  Percentage  Error 
demonstrates  that  the  RDB  system  creates  an  average  percentage  error  of  61.99%. 

StatLstical  Demand  Forecasting  Results.  Table  4-9  illustrates  the  mean  and 
variance  of  the  forecasting  measurement  errors  obtained  with  the  Air  Force  sample  data 
set.  Appendix  F  presents  an  Excel  spreadsheet  which  demonstrates  the  mean  and  variance 
computations. 

The  Requirements  Data  Bank  obtained  a  Mean  Absolute  Deviation  of  7.36  and  a 
Mean  Square  Error  of  3 12.69.  This  demonstrates  the  forecasting  errors  are  not  very 
stable  since  the  MSE  approach  provides  a  large  penalty  for  individual  errors.  The  Mean 
Percentage  Error  of  -23.31%  demonstrates  that  the  RDB  system  under-estimated  the 
seasonal  data  set  demands  by  23.31%.  The  Mean  Absolute  Percentage  Error 
demonstrates  that  the  SDF  system  provides  an  average  percentage  error  of  61.04%. 


Table  4-9.  SDF  Forecasting  Errors 
With  Air  Force  Data 


1  Observations 

245 

7.36 

1  Variance  MAD 

198.22 

Observations 

245 

Average  MSE 

312.69 

Variance  MSE 

1923245.47 

Observations 

245 

-23.30% 

Variance  MPE 

5851.61% 

Observations 

245 

Average  MAPE 

61.04% 

Variance  MAPE 

3829.83% 

Comparative  Results  of  Approach  Two.  Table  4- 10  illustrates  the  results  obtained 
with  the  paired  difference  te.st  when  the  forecasts  were  made  with  the  actual  Air  Force 
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data.  Appendix  F  demonstrates  the  results  of  the  paired  difference  test  at  a  higher  level  of 


detail.  The  results  demonstrate  that  there  is  not  enough  evidence  at  90%  level  confidence 
to  show  that  there  is  a  significant  difference  in  the  level  of  accuracy  provided  by  both  the 
SDF  system  and  the  RDB  system.  In  other  words,  when  using  actual  Air  Force  data,  the 
SDF  system  and  the  RDB  system  provide  approximately  the  same  level  of  accuracy. 


Table  4-10.  Air 


Force  Data  Paired  Difference  Test 


Iteaulto 

MAD 

Ho:m-P2=0 

Ha:pi-U2»^ 

6.88 

7.36 

-0.4072 

1.6450 

1.6450 

Not  enough 
evidence  to 
Reject  Ho 

MSE 

Ho:m.i-i12=0 

Ha:m-|A2’^ 

246.75 

312.69 

-0.5813 

1.6450 

1.6450 

Not  enough 
evidence  to 
Reject  Ho 

MPE 

Ho;m-U2=0 

Ha;M.i-|i2’^ 

-26.39% 

-23.31% 

-0.4662 

1.6450 

1.6450 

Not  enough 
evidence  to 
Reject  Ho 

MAPE 

Ho:m-U2=0 

61.99% 

61.04% 

0.1791 

1.6450 

1.6450 

Not  enough 
evidence  to 
Reject  Ho 

Approach  Three  -  Aircraft  AvailabiUtv  Results 

This  section  presents  the  results  obtained  to  answer  research  question  three:  What 
effects  do  the  forecasts,  computed  by  each  forecasting  approach,  have  on  aircraft 
availability?  The  main  purpose  of  this  approach  is  to  verify  and  evaluate  how  each 
forecasting  approach  affects  the  aircraft  availability  achieved.  The  results  demonstrate 
that  when  there  is  a  trending  component  in  the  data,  the  SDF  system  achieves  a  higher 
aircraft  availability  at  95%  level  confidence  than  the  RDB  system  does.  The  results  also 
demonstrate  that  when  there  are  outliers  in  the  data,  the  SDF  system  achieves  a  higher 
aircraft  availability  than  the  RDB  system  does.  However  the  results  illustrate  that  with  the 
remaining  time  series  component  and  the  real  Air  Force  data,  there  is  not  enough  evidence 
at  90%  level  confidence  to  show  that  there  is  a  significant  difference  between  the  SDF 
system  and  the  RDB  system.  This  section  is  divided  into  three  parts.  The  first  part 
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presents  the  aircraft  availability  achieved  with  the  Requirements  Data  Bank  system.  The 
second  part  presents  the  aircraft  availability  achieved  with  the  Statistical  Demand 
Forecasting  system.  Finally,  the  third  part  provides  the  comparison  findings  between  the 
two  forecasting  systems. 

Requirements  Data  Bank  Results.  Table  4- 1 1  illustrates  the  average  aircraft 
availability  achieved  when  forecasts  are  made  by  the  RDB  system.  The  aircraft  availability 
is  shown  for  four  different  quarters  under  each  of  the  time  series  components  and  the 
actual  Air  Force  data.  Aircraft  Availability  is  computed  with  the  Aircraft  Sustainability 
Model  with  funding  constraint  of  $80,000  for  times  series  components  and  $700,000  for 
the  real  Air  Force  data.  Appendix  G  presents  an  Excel  spreadsheet  which  demonstrates 
the  results. 


Table  4-’  1.  RDB  Aircraft  Availability 


A^Fok^ 

Average  Aircraft 
Availability  -Quarter  1 

74.30% 

78,93% 

86.98% 

83.25% 

91.88% 

79.84'% 

? \  . 

mmsi 

Average  Aircraft 
Availability  -Quarter  2 

74.27% 

78.71% 

86.63% 

82.99% 

88.36% 

_ 

80.28'% 

Average  Aircraft 
Availability  -Quarter  3 

74.10% 

78.92% 

86.64% 

83.15% 

91.00% 

80.36% 

Average  Aircraft 
Availability  -Quarter  4 

74.12% 

78.90% 

86.90% 

82.85% 

90.77% 

80.59% 

Statistical  Demand  Forecasting  Results.  Table  4- 12  illustrates  the  average  aircraft 
availability  achieved  when  forecasts  are  made  by  the  SDF  system.  The  aircraft  availability 
is  shown  for  four  different  quarters  under  each  of  the  time  series  components  and  the 
actual  Air  Force  data.  Aircraft  Availability  is  computed  with  the  Aircraft  Sastainability 
Model  with  funding  constraint  of  $80,000  for  times  series  components  and  $700,000  for 
the  real  Air  Force  data.  Appendix  G  presents  an  Excel  spreadsheet  which  demonstrates 
the  results. 
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Table  4-12.  SDF  Aircraft  AvaUability 


tYdieat 

ftwMlaai 

Aver^  Aircraft 
Availability  -Quarter  1 

75.08% 

80.93% 

87.25% 

84.05% 

90.63% 

78.73% 

Average  Aircraft 
Availability  -Quarter  2 

74.98% 

79.13% 

86.57% 

83.97% 

90.55% 

80.50'^ 

Average  Aircraft 
Availability  -Quarter  3 

74.95% 

78.97% 

87.23% 

83.98% 

90.45% 

Average  Aircraft 
Availability  -Quarter  4 

74.90% 

80.31% 

86.83% 

84.04% 

90.51% 

80.33% 

Comparative  Results  of  Approach  Three.  Table  4-13  illustrates  the  results 
obtained  with  the  paired  difference  test  used  to  compare  the  aircraft  availability  achieved 
with  each  forecasting  system.  Appendix  G  demonstrates  the  results  of  the  paired 
difference  test  at  a  higher  level  of  detail.  The  results  demonstrate  that  when  there  is  a 
trending  component  in  the  data,  the  SDF  system  achieves  a  higher  aircraft  availability  at 
95%  level  confidence  than  the  RDB 


Table  4-13.  Aircraft  Availability  Paired  Difference  Test 


ItotA 

Hypotlttsb 

' 

^teatt 

RDB 

^3 

^Valll« 

7v«b>T4il 
tat  90% 

tat  95% 

Trend 

Ho:m-P2=0 
Hazp.  1-112’^ 

74.20% 

74.98% 

-26.6226 

3.1824 

3.1824 

Seasonal 

Ho:m-P2=0 

Ha;pi-p2^ 

78.87% 

79.83% 

-2.1723 

3.1824 

3.1824 

Cyclical 

Ho:pi-P2=0 

Ha:p|-P2^0 

86.79% 

86.97% 

-1.1481 

3.1824 

3.1824 

Random 

Ho;pi-P2=0 

Ha;m-P2’‘0 

90.50% 

90.54% 

-0.0449 

3.1824 

3.1824 

Outlier 

Ho:pi-P2=0 

Ha:pi-P2’^ 

83.06% 

84.01% 

-10.6221 

3.1824 

3.1824 

Air  Force 

Ho;pi-P2=0 

Ha:p]-P2’^) 

80.27% 

80.06% 

0.6514 

3.1824 

3.1824 

system  does.  The  results  also  demonstrate  that  when  there  are  outliers  in  the  data,  the 
SDF  system  achieves  a  higher  aircraft  availability  than  the  RDB  system  does.  However 
the  results  illustrate  that  with  the  remaining  time  series  component  and  the  real  Air  Force 
data,  there  is  not  enough  evidence  at  90%  level  confidence  to  show  that  there  is  a 
significant  difference  between  the  SDF  system  and  the  RDB  system. 

Chapter  Summary 

This  chapter  discussed  the  results  obtained  for  each  of  the  analytical  approaches  to 
answer  the  three  research  questions.  In  the  case  of  time  series  components,  it  was  found 
that  the  SDF  system  provided  more  accurate  forecasts  than  the  RDB  system,  when  there 
was  a  trend  component  or  an  outlier  component  in  the  data.  It  was  also  found  that  was  no 
significant  difference  in  the  level  of  accuracy  between  the  two  forecasting  systems  when 
there  was  a  seasonal  component,  a  cyclical  component  or  a  random  component  in  the 
data.  In  the  case  of  actual  Air  Force  data,  it  was  found  that  was  no  significant  difference 
in  the  level  of  accuracy  between  the  two  forecasting  systems. 

Finally,  in  the  case  of  aircraft  availability,  it  was  found  that  the  SDF  system 
generated  higher  aircraft  availability  percentage  than  the  RDB  system,  when  there  was  a 
trend  component  or  an  outlier  component  in  the  data.  However  it  was  found  that  there 
was  no  significant  difference  in  the  aircraft  availability  achieved  by  each  forecasting  system 
with  seasonal  component  data,  cyclical  component  data,  random  component  data  or  actual 
Air  Force  data.  The  next  chapter  presents  the  conclusions  and  recommendations  of  this 
forecasting  comparison  research. 
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The  purpose  of  this  chapter  is  to  present  the  conclusions  and  recommendations  of 
this  research.  First  the  chapter  restates  the  specific  problem,  the  purpose  of  the  research 
and  the  research  questions.  Then,  for  each  research  question,  the  chapter  summarizes  the 
results  and  presents  an  interpretation  of  their  management  implications.  Some 
observations  made  regarding  the  forecasting  systems  during  the  research  are  then 
presented.  A  section  on  recommendations  for  future  studies  and  analyses  is  then 
provided.  Finally  the  chapter  gives  a  conclusion  and  a  summary  of  the  research. 

Specific  Problem 

Since  the  JLSC  selected  the  Navy's  Statistical  Demand  Forecasting  System  as  the 
standard  DOD  forecasting  system,  the  Army  and  the  Defense  Logistics  Agency  have  both 
performed  analyses  to  measure  the  impact  of  using  SDF  within  their  own  organizations. 
The  specific  problem  is  that  the  Air  Force  has  not  analyzed  or  studied  how  SDF  could 
affect  its  operational  requirements.  Therefore  the  effect  of  SDF  on  USAF  requirements 
determination  remains  unknown.  This  is  a  problem  because  budget  allocation  across  items 
depends  on  solving  the  statistical  problem  of  forecasting  item  demand  rates 
(Sherbrooke,  1987:  v). 

Purpose  of  the  Study 

The  purpo.se  of  this  .study  is  to  evaluate  and  compare  the  performance  and 


accuracy  of  the  Navy  forecasting  system.  Statistical  Demand  Forecasting,  relative  to  the 
Air  Force  forecasting  system.  Requirements  Data  Bank  Forecasting,  in  an  Air  Force 
environment 


RgssaK^i.QusstiQXis 

The  research  questions  support  the  comparison  between  the  Navy  forecasting 
system  and  the  Air  Force  forecasting  system.  To  address  forecasting  accuracy  and 
robustness,  the  following  research  questions  are  developed; 

1 .  How  does  each  forecasting  system  perform  with  different  data  pattern 
components? 

2.  How  accurate  are  the  forecasts  computed  by  each  forecasting  technique  subject 
to  actual  Air  Force  demand  data? 

3.  What  effects  do  the  forecasts,  computed  by  each  forecasting  approach,  have  on 
aircraft  availability? 

Rgsdltg  and  Mana£gmsflt.Imcli£atiQQiQLR£seafi?li  Oye^tiQn  One 

This  section  summarizes  the  results  obtained  from  the  analysis  of  time  series 
components  and  explains  the  management  implications  that  they  may  have  for  the  Air 
Force. 

Foreca.st  Accuracy  Results  for  Time  Series  Components.  The  results  demonstrate 
that  when  there  is  a  trending  component  in  the  data,  the  SDF  system  provides  more 
accurate  forecasts  at  95%  level  confidence  than  the  RDB  system  does.  The  reason  why 
the  SDF  system  performs  so  well  when  there  is  a  trend  in  the  data  is  that  it  has  the 
capability  of  detecting  the  trend  when  it  exists  in  the  data.  When  a  trend  is  found  in  the 
data,  the  system  will  either  use  a  regression  technique  or  a  four  quarter  moving  average  to 
react  to  the  change  in  the  data.  The  RDB  sy.stem  does  use  a  technique  known  as 
PRELOG  to  detect  a  trend,  but  the  system  does  not  do  use  a  different  forecasting 
technique  to  account  for  the  trend  unless  specified  by  the  item  managers  or  the  equipment 
specialist. 
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The  results  also  demonstrate  that  when  there  are  outliers  in  the  data,  the  SDF 
system  generates  more  accurate  forecasts  than  the  RDB  system.  The  reason  why  the  SDF 
system  performs  so  well  when  there  are  outliers  in  the  data  is  because  of  the  filters  test.  If 
the  filters  test  detects  an  outlier,  it  will  either  ignore  it  or  reduce  it  to  a  lower  value. 
Therefore  the  forecast  generated  by  the  SDF  system  will  remain  stable  with  the  actual 
future  demand.  The  RDB  system  does  not  have  any  measure  to  detect  outliers.  Therefore 
the  full  value  of  the  outlier  is  taken  into  account  to  compute  a  forecast.  This  causes  the 
forecast  to  be  unstable. 

The  results  illustrate  that  with  the  remaining  time  series  component,  there  is  not 
enough  evidence  at  90%  level  confidence  to  show  that  there  is  a  significant  difference 
between  the  SDF  system  and  the  RDB  system.  Both  forecasting  systems  generate 
forecasts  with  approximately  the  same  level  of  forecasting  error. 

Management  Implication.  Occasionally  Air  Force  data  include  time  series 
components  such  as  trend  or  outliers.  An  increasing  program  data  will  cau.se  the  demand 
data  to  increase  also.  An  unexpected  and  short  operational  exercise  may  cause  the 
occurrence  of  many  demands  for  some  items.  The  first  situation  demonstrates  an  example 
of  a  trending  component  In  that  example  the  forecasting  technique  is  required  to  be  very 
responsive  to  the  increase  in  the  demand.  The  second  situation  illu.strates  an  example  of 
an  outlier.  Since  it  is  a  one-time  occurrence,  the  forecasting  technique  is  required  to  be 
very  stable.  The  RDB  system  can  be  responsive  to  the  trending  component  through 
PRELOG,  but  the  process  is  complex  and  requires  the  assistance  of  an  item  manager  or 
equipment  specialist.  Contrary  to  the  RDB  system,  the  SDF  system  is  autonomous.  It 
does  not  require  the  help  of  an  item  manager  or  equipment  specialist  to  respond  to  the 
trend.  The  SDF  system  is  also  very  good  in  detecting  outliers  and  generating  stable 
forecasts.  The  RDB  system  cannot  detect  outliers  and  a  bad  forecast  may  cau.se  the 
system  to  think  that  there  is  an  increase  in  the  demand  data.  For  USAF  item  managers. 
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this  aspect  becomes  very  important  when  the  time  comes  to  determine  what  items  to  buy 
to  maintain  good  aircraft  availability. 

Results  and  Mana2ement  Implication  for  Re.search  Question  Two 

This  section  summarizes  the  results  obtained  from  the  analysis  of  actual  Air  Force 
data  and  explains  the  management  implications  that  they  may  have  for  the  Air  Force. 

Forecast  Accuracy  Results  for  Actual  Air  Force  Data.  The  results  demonstrate 
that  there  is  not  enough  evidence  at  90%  level  confidence  to  show  that  there  is  a 
significant  difference  in  the  level  of  accuracy  between  the  SDF  system  and  the  RDB 
system.  The  data  includes  one  major  time  series  component  known  as  the  random 
component.  Although  there  may  be  outliers  and  trending  components  in  the  data,  they  are 
very  minimal  compared  to  the  random  component.  Since  the  RDB  system  and  the  SDF 
system  generate  relatively  the  same  level  of  accuracy  when  a  random  component  exists  in 
the  data,  the  results  are  not  surprising  with  the  actual  Air  Force  data. 

Management  Implication.  The  SDF  system  and  the  RDB  system  generate 
forecasts  with  approximately  the  same  level  of  accuracy  with  actual  Air  Force  data.  These 
results  demonstrate  that  either  system  represents  a  good  approach  to  generate  foreca.sts 
with  a  fair  level  of  accuracy.  The  Air  Force  requires  a  forecasting  system  that  will 
generate  forecasts  that  are  relatively  stable.  The  question  becomes  which  forecasting  is 
more  cost  effective  to  implement  and  easiest  to  understand. 

Results  and  Management  Implication  for  Re.search  Question  Three 

This  section  .summarizes  the  results  obtained  from  the  analysis  of  aircraft 
availability  and  explains  the  management  implications  that  they  may  have  for  the  Air 
Force. 
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Aircraft  Availability  Results.  The  results  demonstrate  that  when  there  is  a  trending 
component  in  the  data,  the  SDF  system  achieves  a  higher  aircraft  availability  at  95%  level 
confidence  than  the  RDB  system  does.  The  results  also  demonstrate  that  when  there  are 
outliers  in  the  data,  the  SDF  system  achieves  a  higher  aircraft  availability  than  the  RDB 
system  does.  However  the  results  illustrate  that  with  the  remaining  time  series  component 
and  the  real  Air  Force  data,  there  is  not  enough  evidence  at  90%  level  confidence  to  show 
that  there  is  a  significant  difference  between  the  SDF  system  and  the  RDB  system. 

These  results  demonstrate  that  the  more  accurate  the  forecast  is,  the  greater  is  the 
aircraft  availability.  In  the  case  of  outliers  and  trending  components,  a  higher  aircraft 
availability  is  achieved. 

Management  Implication.  The  SDF  system  performs  well  in  detecting  outliers  and 
trending  component  dj»ta.  The  RDB  system  cannot  detect  outliers  and  a  bad  forecast  may 
cause  the  system  to  think  that  there  is  an  increase  in  the  demand  data.  For  USAF  item 
managers,  this  aspect  becomes  very  important  when  the  time  comes  to  determine  what 
mix  of  items  to  buy  to  maintain  a  high  aircraft  availability. 

With  actual  Air  Force  data,  the  SDF  system  and  the  RDB  system  generate 
forecasts  with  approximately  the  same  level  of  aircraft  availability.  These  results 
demonstrate  that  either  system  represents  a  good  approach  to  generate  forecasts  that  will 
provide  relatively  the  same  level  of  aircraft  availability.  The  Air  Force  basically  requires  a 
forecasting  system  that  will  generate  forecasts  that  are  relatively  stable.  The  question 
becomes  which  forecasting  system  is  more  cost  effective  to  implement  and  easiest  to 
understand. 

Observations  on  the  Forecasting  Systems 

The  purpose  of  this  section  is  to  illustrate  some  of  the  advantages  and 
disadvantages  of  each  forecasting  technique  observed  during  the  analysis  study.  This 
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section  first  discusses  the  advantages  and  disadvantages  of  the  Requirements  Data  Bank 
system  and  then  discusses  the  advantages  and  disadvantages  of  the  Statistical  Demand 
Forecasting  system. 

Requirements  Data  Bank  System.  The  Requirements  Data  Bank  system  is 
designed  to  compute  requirements  for  buy  and  repair  for  807,000  consumable  spares, 
recoverable  spares,  repair  parts,  and  equipment  items.  The  Requirements  Data  Bank 
system  is  made  up  of  multiple  sub-systems  which  interface  through  a  relational  database. 

Some  of  the  observed  advantages  associated  with  the  Requirements  Data  Bank 
are: 

1.  The  Requirements  Data  Bank  is  being  developed  using  a  relational  database 
management  system.  The  relational  database  creates  more  efficient  data  management  and 
a  better  interface  between  the  sub-systems.  Therefore,  data  access  and  retrieval  are  easier 
for  the  system's  users. 

2.  The  eight  quarter  moving  average  u.sed  by  the  RDB  system  is  simple  and  easy 
to  understand.  Since  item  managers  deal  with  forecasts  on  a  day  to  day  basis,  an 
understanding  of  what  makes  the  forecasts  leads  tr.  oetter  decisions. 

3.  The  double  exponential  smoothing  method  used  by  the  RDB  system  produces  a 
forecast  with  five  different  alpha  values.  A  mean  absolute  deviation  associated  with  each 
forecast  produced  is  also  computed.  This  helps  the  item  managers  to  make  a  better 
decision  as  to  which  forecasting  technique  could  be  used. 

Some  of  the  disadvantages  observed  on  the  Requirements  Data  Bank  .system  are: 

1.  The  double  exponential  smoothing,  planned  to  be  used  by  the  RDB  .sy.stem.  is  a 
forecasting  technique  that  performs  well  when  there  is  a  trend  in  the  data.  However  this 
technique  has  to  be  selected  by  the  item  manager  or  the  equipment  specialist  to  perform  a 
forecast.  Once  selected,  it  will  remain  the  forecasting  technique  until  the  item  manager  or 
the  equipment  specialist  switches  the  foreca.sting  technique  back  to  the  original  forecasting 
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technique.  The  double  exponential  technique  will  perform  poorly  with  any  other  type  of 
time  series  components.  The  disadvantage  is  that  the  RDB  system  already  uses  a 
forecasting  technique  known  as  PRELOG  for  trending  components.  Therefore  the  double 
exponential  technique  is  not  really  required  for  the  RDB  system.  As  Sherbrooke 
mentioned  in  his  technical  report,  the  Evaluation  of  Demand  Prediction  Techniques,  the 
single  exponential  smoothing  is  a  good  technique  to  forecast  recoverable  items 
(Sherbrooke,  1987:  17).  The  use  of  a  single  exponential  smoothing  technique  instead  of  a 
double  exponential  technique  would  be  more  appropriate. 

2.  The  Requirements  Data  Bank  system  uses  a  technique  known  as  Predictive 
Logistics  to  depict  trending  in  the  data  observations.  Although  the  method  is  a  good 
technique,  it  is  not  user  friendly  and  very  complex.  Therefore,  the  technique  is  rarely 
chosen  by  item  managers  or  equipment  specialists  to  make  forecasts  with  trending  data. 

3.  The  development  of  the  Requirements  Data  Bank  system  started  in  1985.  To 
this  day,  there  are  still  some  processes  or  sections  of  the  RDB  system  that  have  not  been 
developed.  An  example  of  this  is  the  double  exponential  technique. 

4.  The  concept  of  the  RDB  system  is  very  complex.  It  involves  many  algorithms 
and  sub-systems.  Although  the  RDB  system  has  its  own  functional  description 
documents,  very  few  reports  and  analyses  exist  on  the  description  and  purpose  of  the  RDB 
system.  A  descriptive  paper  on  the  RDB  system  would  help  to  clarify  and  strengthen  the 
position  of  the  RDB  system  in  the  DOD  environment 

Statistical  Demand  Forecasting  System.  The  Statistical  Demand  Forecasting 
system  is  a  forecasting  .system  designed  by  the  Navy  to  forecast  both  consumable  and 
recoverable  item  demands.  It  is  a  system  which  includes  a  series  of  statistical  control  tests 
to  detect  whether  the  data  ob.servations  are  changing  radically  or  not  over  time.  Some  of 
the  advantages  of  the  SDF  system  are: 
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1.  The  SDF  system  consists  of  a  variety  of  forecasting  techniques  that  can  be 
selected  by  item  managers  depending  on  the  demand  data  pattern.  Such  techniques  are 
single  exponential  smoothing,  double  exponential  smoothing,  regression,  moving  average, 
naive  method  and  composite  forecasting 

2.  The  SDF  system  consists  of  a  series  of  statistical  control  tests  that  can  depict 
observations  that  are  statistically  inconsistent  with  previous  observations.  These 
inconsistencies  could  be:  a  trend  in  the  data;  the  existence  of  outliers;  bias  forecasts;  or 
unstable  observations.  This  gives  the  SDF  system  and  the  item  managers  the  flexibility  to 
make  a  stable  forecast  when  necessary  or  make  a  responsive  forecast  when  required. 

3.  The  SDF  system  possesses  an  interface  with  the  item  manager's  personal 
computer  known  as  the  PC  Exception  tool.  When  SDF  finds  some  inconsistencies  with 
the  data  such  as  outliers,  the  system  downloads  the  information  to  the  item  managers  to 
review.  At  that  point,  the  item  manager  has  the  flexibility  to  determine  whether  the 
observations  are  valid  and  decide  if  he  /  she  should  choose  a  different  forecasting 
technique. 

Some  of  the  observed  disadvantages  associated  with  the  SDF  system  are: 

1.  The  program  related  items  entered  into  the  SDF  system  are  not  processed 
through  all  the  statistical  control  tests.  For  example  the  trend  test  is  not  currently  used  for 
program  related  items.  The  Navy  intends  to  change  the  SDF  system  in  the  future  so  that 
program  related  items  can  be  processed  through  the  trend  test  (Maitland,  1992a). 

2.  The  SDF  system  is  a  complex  system.  The  system  consists  of  many  statistical 
functions  and  algorithms.  Unless  item  managers  have  a  statistical  background,  it  may  be 
difficult  for  them  to  understand  the  functions  of  the  SDF  system. 

3.  The  SDF  system  contains  a  multiple  of  parameters  that  must  be  set  for  the 
system  to  operate.  Although  default  values  exist,  these  parameters  can  be  .set  by  item 
managers.  The  values  of  these  parameters  greatly  affect  the  forecast  that  will  be  generated 
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by  the  system.  Therefore,  parameter  setting  becomes  important.  There  is  no  method  or 
approach  that  exists  at  this  point  to  evaluate  an  optimal  parameter  setting. 

Recommendations  For  Future  Studies  and  Analv.se.s 

As  discussed  above,  the  research  demonstrates  that  there  is  no  significant 
difference  between  the  two  forecasting  systems.  The  question  on  whether  the  Joint 
Logistics  System  Center  should  maintain  its  decision  on  using  the  Statistical  Demand 
Forecasting  system  as  the  DOD  standard  forecasting  system  does  not  depend  on 
forecasting  accuracy,  but  on  the  costs  involved  in  integrating  one  system  versus  the  other 
and  the  flexibility  of  implementing  the  forecasting  system. 

It  is  recommended  that  a  cost  analysis  of  integrating  and  implementing  one  system 
versus  the  other  be  done.  Factors  such  as  system  interface,  system  maintenance,  system 
flexibility  and  system  complexity  should  also  be  considered.  Perhaps,  the  integration  of 
some  of  the  SDF  algorithms  into  the  RDB  system  would  be  an  ideal  solution. 

Studies  or  analyses  related  to  this  research  that  could  be  done  are: 

1 .  SDF  possesses  other  forecasting  techniques  other  than  the  moving  average 
technique  to  generate  forecasts.  A  comparison  on  comparing  the  SDF  exponential 
smoothing  technique  to  the  RDB  moving  average  would  be  interesting. 

2.  The  RDB  system  does  not  have  any  .stati.stical  control  tests  to  detect  data 
patterns.  An  analysis  on  using  statistical  control  tests  with  the  RDB  algorithm  is  an  area 
which  could  improve  RDB  forecasting. 

3.  The  RDB  forecasting  system  uses  the  Mean  Absolute  Deviation  as  a  measure  of 
forecasting  performance.  A  study  on  using  aircraft  availability  as  a  forecasting 
performance  in.stead  of  the  MAD  could  improve  aircraft  availability. 


5-9 


Conclusions 

Dealing  with  forecasting  remains  a  very  complicated  matter  because  no  one  can 
predict  the  future  and  be  one  hundred  percent  accurate.  As  the  French  author  Eugene 
Inonesco  says:  "You  can  only  predict  things  after  they  have  happened"  (Augarde. 

199 1 : 1 10).  Many  factors  can  affect  demand  such  as  economic  conditions,  political 
decisions,  weather  conditions,  number  of  flying  hours,  number  of  sorties  and  so  on.  For 
this  reason,  a  level  of  uncertainty  exists.  To  reduce  the  level  of  uncertainty,  one 
forecasting  technique  may  be  good  at  one  point  and  another  forecasting  technique  may  be 
better  at  another  point  in  time. 

The  results  of  this  research  demonstrate  that  in  general  there  is  no  significant 
difference  in  the  forecasts  provided  by  the  RDB  system  versus  the  forecasts  provided  by 
the  SDF  system.  However  the  SDF  system  did  provide  more  accurate  forecasts  than  the 
RDB  system  did  in  the  case  of  data  that  included  trending  components  or  outliers. 

Research  Summary 

This  research  presented  the  problem  of  comparing  the  Air  Force's  Requirements 
Data  Bank  forecasting  approach  to  the  Navy's  Statistical  Demand  Forecasting  approach. 
The  research  consisted  of  five  chapters.  The  first  chapter  introduced  the  purpose  of  the 
research  and  the  background  surrounding  it.  The  second  chapter  presented  some  of  the 
concepts  discussed  throughout  the  research.  The  third  chapter  illustrated  the 
methodology  used  for  the  research.  Chapter  four  provided  the  results  and  analysis  of  the 
study.  Finally,  this  chapter  made  some  recommendations  for  future  studies. 
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**  The  purpose  of  this  program  is  to  generate  trend  times  series  ** 
**  component  data.  ** 


PROGRAM  TREND 
**  Variables  ** 

CHARACTER  LINE*190,NSN*17 

INTEGER  RECORD,X, J, I,VALUE(16) ,FLH(16) , PROG(25) 

X=100 

J=2 

Y=1 

**  Format  ** 

1000  FORMAT ( 12, A190) 

1001  FORMAT  (A17) 

1002  F0RMAT(A2,A17,4X,I5,15(2X,I5) ) 

1003  FORMAT(A2,A17,4X, 15,24 (2X, 15) ) 

1004  FORMAT (A2,A190) 

**  Opening  Files  ** 

OPEN (l,file=' SDFRDB1.TXT' , form= ' formatted’ , status= ’UNKNOWN' ) 
OPEN(2, file=’ TREND. TXT’ , form= ’ formatted’ , status=’ UNKNOWN' ) 

**  Reading  Input  File  for  NSNs  information  only  ** 

10  READ  (1, 1000,end=999)  RECORD, LINE 

IF  ( RECORD. EQ. 01)  THEN 

WRITE  (2,1004)  ’01’, LINE 

ENDIF 

**  Generating  Demand  ** 

IF  ( RECORD. EQ. 02)  THEN 
READ  (LINE, 1001)  NSN 
DO  20  1=1,16 
VALUE ( I ) =X+ J 
J=J+Y 
CONTINUE 
X=X+10 

J=INT(RND() *10) 

Y=INT(RND() *10) 

IF  ( (Y.LT.l) .OR. (Y.GT.5) )  THEN 
GOTO  25 
ENDIF 

Demand  *  * 

WRITE (2, 1002)  ’02’ , NSN , VALUE ( 1 ) , VALUE (2) , VALUE (3) , VALUE (4) , 

VALUE (5) , VALUE (6) , VALUE (7) , VALUE (8) .VALUE (9) .VALUE (10) , 
VALUE (11) .VALUE (12) .VALUE (13) .VALUE (14) .VALUE (15) , 

VALUE (16) 

ENDIF 


20 

25 

**  Writing 


Sc 

& 

Sc 


A-1 


★  ★ 


Generating  Flying  Program 


★  it 


IF  (RECORD. EQ. 03)  THEN 
READ  (LINE, 1001)  NSN 
DO  30  1=1,16 

FLH(I) =2000+X 
30  CONTINUE 

WRITE(2, 1002)  •03*  ,NSN.FLH(1)  ,FLH(2)  ,FLH(3)  ,FLH(4)  ,FLH<:5) 

Sc  FLH(6)  ,FLH(7)  ,FLH(8)  ,FLH(9)  ,FLH(10)  ,FLH(11)  , 

Sc  FLH(12)  ,FLH(13)  ,FLH(14)  ,FLH(15)  ,FLH(16) 

ENDIF 


IF  (RECORD. EQ. 04)  THEN 
READ  (LINE, 1001)  NSN 
DO  40  1=1,25 

PROG (I) =2500 
40  CONTINUE 


**  Writing  Flying  Program  ** 


Sc 

Sc 

Sc 

Sc 

Sc 


WRITE (2, 1003)  '04' ,NSN,PROG(l) , PROG (2) , PROG (3) , PROG (4) , 
PROG  ( 5 )  , 

PROG  (6)  ,  PROG  (7)  ,  PROG  (8)  ,  PROG  (9)  ,  PROG  (10)  ,  PROG  (11) 
PROG(12) ,PROG(13) ,PROG(14) ,PROG(15) ,PROG(16) , 

PROG  (17)  ,  PROG  (18)  ,  PROG  (19)  ,  PROG  (20)  ,  PROG  (21)  , 

PROG (22) , PROG (23) , PROG (24) , PROG (25) 

ENDIF 


GOTO  10 
999  CLOSE (1) 
CLOSE (2) 
STOP 
END 
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2)  Seasonal  Times  Series  Component 


★  ★★★★★★★★★★★★★★★★★★★★•^★★llr*********%*-*r**********itr**'A-****T>r****^*******nr» 

**  The  purpose  of  this  program  is  to  generate  seasonal  times  series  ' 
**  component  data.  * 


PROGRAM  SEASONAL 

**  Variables  ** 

CHARACTER  LINE*190 ,NSN*17 

INTEGER  RECORD.X, J, I,VALUE(16) ,FLH(16) , PROG(25) 

X=100 

J=2 

Z=1 

**  Format  ** 

1000  FORMAT! 12, A190) 

1001  FORMAT  (A17) 

1002  FORMAT (A2,A17,4X, 15 , 15 (2X, 15) ) 

1003  FORMAT(A2,A17,4X,I5,24(2X,I5) ) 

1004  FORMAT (A2,A190) 

**  Opening  Files  ** 

OPEN ( 1 , f ile= ' SDFRDB2 .TXT ' , form= ' formatted ' , status= ' UNKNOWN ' ) 
OPEN {2 , f ile= ' SEASONAL.TXT' , f orm= ' formatted ' , status= ' UNKNOWN ' ) 

**  Reading  Input  File  for  NSNs  information  only  ** 

10  READ  (1, 1000,end=999)  RECORD, LINE 
IF  ( RECORD. EQ. 01)  THEN 

WRITE  (2,1004)  ■01‘,LINE 
ENDIF 

**  Generating  Demand  ** 

IF  (RECORD. EQ. 02)  THEN 
READ  (LINE, 1001)  NSN 
VALUE ( 1 ) =X+ J 
VALUE(2)=X+J+1+Z 
VALUE(3)=X+J+2+Z 
VALUE(4) =X+J+1+Z 
VALUE ( 5 ) =X+ J 
VALUE (6) =X+J+1+Z 
VALUE(7)=X+J+2+Z 
VALUE(8) =X+J+1+Z 
VALUE ( 9 ) =X+ J 
VALUE ( 10 ) =X+J+1+Z 
VALUE ( 11 ) =X+J+2+Z 
VALUE(12) =X+J+1+Z 
VALUE! 13 )=X+J 
VALUE ( 14 ) =X+J+1+Z 
VALUE ( 15 ) =X+J+2+Z 
VALUE (16) =X+J+1+Z 
X=X+10 

J=INT(RND( ) *10) 

25  Z=INT(RND() *10) 

IF  ( (Z.LT.l) .OR. {Z.GT.5) )  THEN 
GOTO  25 
ENDIF 
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-*  -k 


Writing  Demand 


*  it 


WRITE(2, 1002)  ‘02' , NSN, VALUE ( 1 ) ,VALUE(2) ,VALUE(3) ,VALUE(4) , 

&  VALUE (5) .VALUE (6) .VALUE (7) .VALUE (8) .VALUE (9) .VALUE (10) . 

&  VALUE { 11 ) . VALUE ( 12 ) . VALUE ( 13 ) , VALUE ( 14 ) . VALUE ( l5 ) . 

&  VALUE (16) 

ENDIF 

**  Generating  Flying  Program  ** 

IF  ( RECORD. EQ. 03)  THEN 
READ  (LINE. 1001)  NSN 
DO  30  1=1.16 

FLH(I)=2000+X 
30  CONTINUE 

**  Writing  Flying  Program  ** 

WRITE(2. 1002)  '03  '  .NSN.FLHd)  ,FLH(2)  ,FLH(3)  .FLH(4)  .  FLH  (  5  )  . 

Sc  FLH(6)  ,FLH(7)  .FLH(8)  ,FLH(9)  .FLH(IO)  .FLH(ll)  . 

Sc  FLH(12)  .FLH(13)  ,FLH(14)  .FLH(15)  .FLH(16) 

ENDIF 

IF  ( RECORD. EQ. 04)  THEN 
READ  (LINE, 1001)  NSN 
DO  40  1=1,25 

PROG (I) =2500 
CONTINUE 

WRITE(2, 1003)  '04' ,NSN,PROG(l) ,PROG(2) ,PROG(3) ,PROG(4) , 

PROG (5) , 

PROG(6)  ,PROG(7) ,PROG(8) ,PROG(9) ,PROG(10)  ,PROG(ll)  , 
PROG(12) ,PROG(13) ,PROG(14) ,PROG(15) ,PROG(16) , 

PROG(17) ,PROG(18) ,PROG(19) ,PROG(20) ,PROG(21) , 

PROG(22) ,PROG(23) ,PROG(24) ,PROG(25) 

ENDIF 


GOTO  10 
999  CLOSE (1) 

CLOSE (2) 
STOP 
END 
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3)  CvcUcal  Times  Series  Component 


*•  The  purpose  of  this  program  is  to  generate  cyclical  times  series  ’ 
**  component  data.  * 


PROGRAM  CYCLICAL 

**  Variables  ** 

CHARACTER  LINE*190 , NSN*17 

INTEGER  RECORD,X, J, I,VALUE(16) ,FLH(16) , PROG (25) 

X=100 

J=2 

Z=1 

*  *  Format  *  * 

1000  FORMAT! 12, A190) 

1001  FORMAT  {A17) 

1002  FORMAT(A2,A17,4X,I5,15(2X,I5) ) 

1003  F0RMAT{A2,A17,4X,I5,24(2X,I5) ) 

1004  FORMAT {A2,A190) 

**  Opening  Files  ** 

OPEN ( 1, file=' SDFRDB3 .TXT' , form= ' formatted ’ , status= ' UNKNOWN ' ) 
OPEN { 2, file= 'CYCLICAL.TXT' , f orm= ' formatted ' , status= ' UNKNOWN ' ) 

**  Reading  Input  File  for  NSNs  information  only  ** 

10  READ  (1, 1000,end=999)  RECORD, LINE 
IF  (RECORD. EQ. 01)  THEN 

WRITE  (2,1004)  '01', LINE 
ENDIF 

**  Generating  Demand  ** 

IF  ( RECORD. EQ. 02)  THEN 
READ  (LINE, 1001)  NSN 
VALUE ( 1 ) =X+J 
VALUE(2) =X+J+1+Z 
VALUE(3) =X+J+2+Z 
VALUE(4)=X+J+1+Z 
VALUE ( 5 ) =X+ J 
VALUE(6) =X+J-1-Z 
VALUE(7) =X+J-2-Z 
VALUE{8) =X+J-1-Z 
VALUE(9) =X+J 
VALUE (10) =X+J+1+Z 
VALUE (11) =X+J+2+Z 
VALUE! 12 )=X+J+1+Z 
VALUE! 13 )=X+J 
VALUE(14) =X+J-1-Z 
VALUE ( 15 ) =X+J-2-Z 
VALUE(16) =X+J-1-Z 
X=X+10 

J=INT(RND( ) *10) 

25  Z=INT(RND( ) *10) 

IF  ( (Z.LT. 1) .OR. (Z.GT.5) )  THEN 
GOTO  25 
ENDIF 
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it  it 


Writing  Demand  ** 


WRITE(2, 1002)  ■02' ,NSN,VALUE(1) ,VALUE(2) ,VALUE(3) , VALUE ( 4 ) , 

&  VALUE(5) ,VALUE(6) ,VALUE(7) ,VALUE(8) , VALUE ( 9 ) ,VALUE(10) , 

&  VALUE (11) .VALUE (12) .VALUE (13) .VALUE (14) .VALUE (15) , 

&  VALUE (16) 

ENDIF 

•»  Generating  Flying  Program  ** 

IF  (RECORD. EQ. 03)  THEN 
READ  (LINE, 1001)  NSN 
DO  30  1=1,16 

FLH(1)=2000+X 
3  0  CONTINUE 

**  Writing  Flying  Program  ** 

WRITE(2, 1002)  'OS' ,NSN,FLH(1) ,FLH(2) ,FLH(3) ,FLH(4) ,FLH(5) , 

&  FLH(6) ,FLH(7) ,FLH(8) ,FLH(9) ,FLH(10) ,FLH(11) , 

&  FLH ( 12 ) , FLH ( 13 ) , FLH ( 14 ) , FLH ( 15 ) , FLH ( 16 ) 

ENDIF 

IF  ( RECORD. EQ. 04)  THEN 
READ  (LINE, 1001)  NSN 
DO  40  1=1,25 

PROG (I) =2500 
CONTINUE 

WRITE(2, 1003)  '04' ,NSN,PROG(l) ,PROG(2) ,PROG(3) ,PROG(4) , 

PROG(5) , 

PROG(6) ,PR0G(7) ,PROG(8) .PR0G(9) ,PROG(10) ,PR0G(11) , 
PROG(12) ,PR0G(13) ,PROG(14) ,PROG(15) ,PROG(16) , 

PROG(17) ,PROG(18) ,PROG(19) ,PROG(20) ,PROG(21) , 

PROG  (22)  ,  PROG  (23)  ,  PROG  (24)  ,  PROG  (25) 

ENDIF 


GOTO  10 
999  CLOSE (1) 
CLOSE (2) 
STOP 
END 
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*  The  purpose  of  this  program  is  to  generate  random  times  series  ** 

*  component  data.  ** 


PROGRAM  RANDOM 
**  Variables  ** 

CHARACTER  LINE*190 , NSN*17 

INTEGER  RECORD.X, J, I,VALUE{16) ,FLH(16) , PROG(25) 

X=100 

J=2 

Y=1 

**  Format  ** 

1000  FORMAT ( 12, A190) 

1001  FORMAT  (A17) 

1002  FORMAT (A2,A17,4X, 15 , 15 (2X, 15 ) ) 

1003  FORMAT(A2,A17,4X,I5,24(2X,I5) ) 

1004  FORMAT {A2,A190) 

**  Opening  Files  ** 

OPEN ( 1 ,  files  '  SDFRDB5  ."XT'  ,  form= '  format te'^  '  ,  status  =  '  UNKNOWN '  ) 
OPEN (2 , files 'RANDOM.TXT' , forms'  formatted' , statuss ' UNKNOWN' ) 


*•  Reading  Input  File  for  NSNs  information  only  ** 

10  READ  (1, 1000,ends999)  RECORD, LINE 
IF  ( RECORD. EQ. 01)  THEN 

WRITE  (2,1004)  '01', LINE 

ENDIF 

**  Generating  Demand  ** 

IF  ( RECORD. EQ. 02)  THEN 
READ  (LINE, 1001)  NSN 
DO  20  1=1,16 

VALUE ( I ) sX+INT (RND ( ) *10 ) 

20  CONTINUE 

X=X+10 

**  Writing  Demand  ** 

WRITE (2, 1002)  '02' , NSN , VALUE ( 1 ) , VALUE (2) , VALUE (3) , VALUE ( 4 ) , 

VALUE  ( 5 )  ,  VALUE  ( 6 )  ,  VALUE  (7 )  ,  VALUE  ( 8  )  ,  VALUE  (  9  )  ,  VALUE  (10), 
&  VALUE (11) , VALUE (12) , VALUE (13) ,VALUE(14) , VALUE (15) , 

&  VALUE (16) 

ENDIF 

**  Generating  Flying  Program  ** 

IF  ( RECORD. EQ. 03)  THEN 
READ  (LINE, 1001)  NSN 
DO  30  1=1,16 

FLH(I) =2000+X 
30  CONTINUE 
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If’ 


*  # 


Writing  Flying  Program 


*  it 


WRITE (2, 1002)  '03  * ,NSN,FLH(1) ,FLH(2) ,FLH(3) ,FLH(4) , FLH ( 5 )  , 

FLH(6) ,FLH(7) ,FLH(8) ,FLH(9) , FLH (10) , FLH (11) , 

FLH (12) , FLH (13; , FLH (14) , FLH (15) , FLH (16) 

ENDIF 


40 


Sl 

£c 

Sc 

Sc 

Sc 


IF  ( RECORD. EQ. 04)  THEN 
READ  (LIl'lE,  1001) 

DO  40  1=1,25 

PROG(I) =2500 
CONTINUE 

WRITE(2,1003)  ‘04' ,NSN,PROG(l) ,PROG(2) , PROG ( 3 ) ,PROG(4) , 

PROG ( 5 ) , 

PROG(6) ,PROG(7) ,PROG(8) , PROG ( 9 ) ,PROG(10) ,PROG(ll) , 
PROG ( 12 ) , PROG ( 13 ) , PROG ( 14 ) , PROG ( 15 ) , PROG ( 16 ) , 
PROG(17) ,PROG(18) ,PROG(19) ,PROG(20) ,PROG(21) , 

PROG (22) , PROG (23) , PROG (24) , PROG (25) 

ENDIF 


GOTO  10 
999  CLOSE (1) 

CLOSE (2) 
STOP 
END 
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**  The  purpose  of  this  program  is  to  generate  outlier  time^  series  ** 
’■*  component  data.  ** 


PROGRAM  OUTLIER 
**  Variables  ** 

CHARACTER  LINE*190,NSN*17 

INTEGER  RECORD, X,J,G,Z,F, I, VALUE (16) ,FLH{16) , PROG (25) 

X=100 

J=2 

F  =  0 

G=0 

Z=50 


**  Format  ** 

1000  FORMAT ( 12, A190) 

1001  FORMAT  (A17) 

1002  FORMAT(A2,A17,4X,I5,15(2X,I5) ) 

1003  FORMAT (A2,A1 7, 4X, 15 , 24 (2X, 15) ) 

1004  FORMAT (A2,A190) 

**  Opening  Files  ** 

OPEN (1 , f ile= ' SDFRDB4.TXT' , form= ' formatted’ , status= ' UNKNOWN ' ) 
OPEN (2, file= 'OUTLIER.TXT' , form=  *  formatted' , status= ' UNKNOWN' ) 

**  Reading  Input  File  for  NSNs  information  only  ** 

10  READ  (1, 1000,end=999)  RECORD, LINE 

IF  ( RECORD. EQ. 01)  THEN 

WRITE  (2,1004)  '01', LINE 

ENDIF 

**  Generating  Demand  ** 

IF  (RECORD. EQ. 02)  THEN 
READ  (LINE,i001)  NSN 
VALUE ( 1 ) =X+J 
VALUE(2) =X+J 
VALUE(3) =X+J 
VALUE(4)=X+J 
VALUE(5) =X+J 
VALUE ( 6 ) =X+J 
VALUE(7) =X+J 
VALUE(8)=X+J 
VALUE(9) =X+J 
VALUE ( 10 ) =X+J 
VALUE ( 11 )=X+J 
VALUE ( 12 ) =X+J 
VALUE ( 13 ) =X+J+F 
VALUE (14) =X+J+G 
VALUE ( 15 ) =X+J+Z 
VALUE ( 16 ) =X+J 
X=X+10 
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J=J+INT(RND() *10) 

IF  (Z.GT.O)  THEN 
G=10*INT(RND{) *10) 

F=10*INT(RND() *10) 

Z=0 

ELSE 

IF  (F.GT.O)  THEN 
G=10*INT(RND() *10) 

F=0 

Z=0 

ELSE 

IF  (G.GT.O)  THEN 
G=0 

F=10*INT(RND() *10) 

Z=0 

ELSE 

G=0 

F=0 

Z=10*INT(RND() *10) 

ENDIF 

ENDIF 

ENDIF 

**  Writing  Demand  ** 

WRITE(2, 1002)  '02' , NSN , VALUE ( 1 ) ,VALUE(2) ,VALUE(3) ,VALUE(4) , 

&  VALUE (5) .VALUE (6) .VALUE (7) .VALUE (8) .VALUE (9) .VALUE (10) , 

&  VALUE (11) .VALUE (12) .VALUE (13) .VALUE (14) .VALUE (15) , 

&  VALUE (16) 

ENDIF 

**  Generating  Flying  Program  ** 

IF  ( RECORD. EQ. 03)  THEN 
READ  (LINE. 1001)  NSN 
DO  30  1=1.16 

FLH(I) =2000+X 
3  0  CONTINUE 

**  Writing  Flying  Program  ** 

WRITE (2. 1002)  '03 • .NSN.FLH(l) ,FLH(2) .FLH(3) .FLH(4) ,FLH(5) , 

&  FLH(6) ,FLH(7) ,FLH(8) ,FLH(9) ,FLH(10) ,FLH(11) . 

&  FLH(12) .FLH(13) ,PLH(14) .FLH(15) .FLH(16) 

ENDIF 

IF  (RECORD. EQ. 04)  THEN 
READ  (LINE. 1001)  NSN 
DO  40  1=1.25 

PROG(I) =2500 
CONTINUE 

WRITE (2. 1003)  ‘04’ .NSN. PROG (1) . PROG (2) . PROG (3) , PROG ( 4 ) . 

PROG (5) , 

PROG(6) .PROG(7) .PROG(8) .PROG(9) .PROG(IO) ,PROG(ll) , 
PROG(12) .PROG(13) .PROG(14) ,PROG(15) ,PROG(16) , 

PROG(17) ,PROG(18) ,PROG(19) .PROG(20) ,PROG(21) , 

PROG (22) .PROG (23) .PROG (24) .PROG (25) 

ENDIF 

GOTO  10 
999  CLOSE (1) 

CLOSE (2) 

STOP 

END 


40 

Sc 

& 

Sc 

& 

Sc 
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Descriptive  Statistics 


Population 

Sample 

Mean 

2.3626 

Mean 

4.9175 

Standard  Error 

Standard  Error 

0.2921 

Median 

1.3267 

Median 

2.507 1 

Mode 

Mode 

0.8755 

Standard  Dev. 

3.8715 

Standard  Dev. 

6.8701 

Variance 

14.9886 

Variance 

47.1984 

Kurtosis 

120.9590 

Kurtosis 

15.5797 

Skewness 

8.5627 

Skewness 

3.4689 

Range 

90.4566 

Range 

60.6485 

Minimum 

0.0000 

Minimum 

0.2954 

Maximum 

90.4566 

Maximum 

60.9439 

Sum 

15354.7025 

Sum 

2719.3509 

Count 

6499.0000 

Count 

553.0000 

Computing  Sample  Size  with  99%  Confidence 


Sample  Size  =  [(2.575)  (Sample  Standard  Dev)  /  (Value  within  Mean)]^2 


DATA 

Mean 

MSM 

Beginning  Sample  Std.  Dev. 

Value  within 

0.0480 

Mean 

Sample  size= 

245.3817 

Descriptive  Statistics 


Sample 


Mean 

Standard  Error 

Median 

Mode 

Standard  Dev. 

Variance 

Kurtosis 

Skewness 

Range 

Minimum 

Maximum 

Sum 

Count 


Computing  Sample  Size  with  99%  Confidence 

Sample  Size  =  [(2.575)  (Sample  Standard  Dev)  /  (Value  within  Mean)]''2 


DATA 


Mean 

Beginning  Sample  Std.  Dev. 

Value  within 

Mean 


Sample  size 


36.59026 


Descriptive  Statistics 


Sample _ 

Mean 

Standard  Error 

Median 

Mode 

Standard  Dev. 

Variance 

Kurtosis 

Skewness 

Range 

Minimum 

Maximum 

Sum 

Count 


Computing  Sample  Size  with  99%  Contidence 


Sample  Size  =  [(2.575)  (Sample  Standard  Dev)  /  (Value  within  Mean)]''2 


DATA 

Mean 

Beginning  Sample  Std.  Dev. 

Value  within 

0.0480 

Mean 

Sample  size= 

0.163108 
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Descriptive  Statistics 


Sample _ 

Mean 

Standard  Error 

Median 

Mode 

Standard  Dev. 

Variance 

Kurtosis 

Skewness 

Range 

Minimum 

Maximum 

Sum 

Count 


Computing  Sample  Size  with  99%  Confidence 

Sample  Size  =  [(2.575)  (Sample  Standard  Dev)  /  (Value  within  Mean)]''2 


DATA 

Mean 

Beginning  Sample  Std.  Dev. 

1 

Value  within 

0.0480 

Mean 

Sample  size- 

0.009829 
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Descriptive  Statistics 


Sample _ 

Mean 

Standard  Error 

Median 

Mode 

Standard  Dev. 

Variance 

Kurtosis 

Skewness 

Range 

Minimum 

Maximum 

Sum 

Count 


Computing  Sample  Size  with  99%  Confidence 


Sample  Size  =  [(2.575)  (Sample  Standard  Dev)  /  (Value  within  Mean)]'^2 


DATA 


Mean 

Beginning  Sample  Std.  Dev. 

Value  within 

Mean 


Sample  size 


35.55079 


Descriptive  Statistics 


Sample 

Mean 

Standard  Error 

Median 

Mode 

Standard  Dev. 

Variance 

Kurtosis 

Skewness 

Range 

Minimum 

Maximum 

Sum 

1.2267 

Count 

40.0000 

Computing  Sample  Size  with  99%  Contidence 

Sample  Size  =  [(2.575)  (Sample  Standard  Dev)  /  (Value  within  Mean)]''2 


DATA 

Mean 

Beginning  Sample  Std.  Dev. 

Value  within 

Mean 

Sample  size= 

0.016007 
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Appendix  C:  RDB  Ei2ht  Quarter  Moving  Avera£e 


★  ♦★★★★★★★★★★★★★★★♦★♦★★★★♦★★Hr********#***-*******#*  * 

***  THIS  PROGRAM  IS  TO  SIMULATE  THE  RDB  EIGHT  QUARTER  MOVING  *** 

***  AVERAGE  FORECASTING  TECHNIQUE. 

***  FORECASTING  TECHNIQUE  TO  FORECAST  OIM  DEMAND.  *** 

***  SIMULATION  PROGRAM  DEVELOPED  BY  CAPT  CHRISTIAN  DUSSAULT.  *** 


PROGRAM  MOVAVE 

***  VARIABLES  DECLARATION 

INTEGER  TYPE , COUNT/ 0 / , TOTALCOUNT/ 0 / 

CHARACTER  *  15  NSN 
CHARACTER  *  9  NUN 
CHARACTER  *  200  LINE 

REAL  FORECAST (16) ,  DEMAND(16),  PROGRAM(16),  OIMDEMANDRATE (16 ) , 
&  MAD,  MSE,  MPE,  MAPS,  TOTALPROGRAM/ 0 . 0/ ,  TOTALDEMAND/ 0 . 0/ , 

Sc  ERROR(4), 

Sc  COUNTERROR /0.0/,COUNTMAPE/0.0/, 

&  MAPETOTAL/0 . 0/ , COUNTMAD/0 . 0/ ,MADTOTAL/ 0 . 0/ , 

Sc  COUNTMSE/  0 . 0  /  ,  MSETOTAL/  0 . 0  /  ,  COUNTMPE/  0.0/,  MPETOTAL/  0 . 0  / 

***  FILES 

OPEN  ( 1 , FILE= ' trend . TXT ' , FORM= • FORMATTED ' , STATUS= ' UNKNOWN ‘ ) 
OPEN  ( 2 , FILE= ■ trend . RDB ' , FORM= ' FORMATTED ' , STATUS= ' UNKNOWN • ) 

•**  FORMATS 

1000  FORMAT(2X,A15,2X,16I7) 

2000  FORMAT ( 12, A200) 

3000  FORMAT (A2,2X,A1 5, 2X, 4 (2X,F8.2) ) 

4000  FORMAT(A2,2X,A9,4(2x,F10.4) ) 

5000  FORMAT  C+NSN  COUNT:  ’,15) 

8000  FORMAT (4X,A9) 

***  READING  INPUT  FILE 

DO 

READ(l,2000,fiND=110)  TYPE,  LINE 

IF  (TYPE.EQ.l)  THEN 
COUNT=COUNT+l 
TOTALCOUNT=0 
GOTO  100 
ENDIF 

IF  (TYPE.EQ.2)  THEN 

READ(LINE, 1000)  NSN , DEMAND ( 1 ), DEMAND ( 2 ) ,DEMAND(3) , 

Sc  DEMAND(4)  ,DEMAND(5)  ,DEMAND(6)  ,DEMAND(7)  ,DEMAND(8)  , 

Sc  DEMAND (9) , DEMAND (10) , DEMAND (11) , DEMAND (12) , DEMAND (13) , 

Sc  DEMAND  ( 14 ),  DEMAND  (15)  ,  DEMAND  (16) 

GOTO  100 
ENDIF 
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IF  (TYPE.EQ.3)  THEN 

READ (LINE, 1000)  NSN , PROGRAM ( 1 ) ,PROGRAM(2) ,PROGRAM(3) , 

&  PROGRAM ( 4 ) , PROGRAM ( 5 ) , PROGRAM ( 6 ) , PROGRAM (7 ) , PROGRAM ( 8 ) , 

&  PROGRAMO)  ,PROGRAM(10)  ,PROGRAM(ll)  ,PROGRAM{12)  , 

&  PROGRAM ( 13 ) , PROGRAM ( 14 ) , PROGRAM { 15 ) , PROGRAM ( 16 ) 

ENDIF 

IF  (TYPE.EQ.4)  THEN 
GOTO  100 
ENDIF 

FORECAST  FOR  PERIOD  9  USING  THE  PREVIOUS  8  QUARTERS 

TOTALDEMAND=DEMAND  ( 1 )  -t-DEMAND  ( 2 )  +DEMAND  ( 3  )  +DEMAND  (  4 )  + 

&  DEMAND(5) +DEMAND(6) +DEMAND(7) +DEMAND(8) 

TOTALPROGRAM=  PROGRAM ( 1 ) +  PROGRAM ( 2 ) +  PROGRAM ( 3 ) +  PROGRAM ( 4 )  + 

Sc  PROGRAM  ( 5 )  +PROGRAM  { 6 )  +PROGRAM  (7  )  +PROGRAM  ( 8 ) 

IP  (TOTALPROGRAM.EQ.O)  THEN 
FORECAST (9) =0.0 
GOTO  10 
ELSE 

OIMDEMANDRATE ( 9 ) =TOTALDEMAND/TOTALPROGRAM 
FORECAST ( 9 ) =OIMDEMANDRATE ( 9 ) * PROGRAM ( 9 ) 

ENDIF 


FORECAST  FOR  PERIOD  10  USING  THE  PREVIOUS  8  QUARTERS 

TOTALDEMANDsDEMAND ( 2 ) +DEMAND (3 ) +DEMAND ( 4 ) +DEMAND ( 5 ) + 

Si  DEMAND(6)+DEMAND(7)+DEMAND(8) +DEMAND(9) 

TOTAL PROGRAMS PROGRAM (2 ) +PROGRAM (3 ) +PROGRAM (4 ) +PROGRAM ( 5 ) + 
Sc  PROGRAM  ( 6 )  +  PROGRAM  ( 7 )  +  PROGRAM  ( 8 )  +  PROGRAM  ( 9  ) 

IF  (TOTALPROGRAM.EQ.O)  THEN 
FORECAST (10) =0.0 
GOTO  20 
ELSE 

OIMDEMANDRATE (10) =TOTALDEMAND/TOTALPROGRAM 
FORECAST ( 1 0 ) =0 IMDEMANDRATE (10)*  PROGRAM (10) 
TOTALCOUNT=TOTALCOUNT+ 1 
ENDIF 


FORECAST  FOR  PERIOD  11  USING  THE  PREVIOUS  8  QUARTERS 

TOTALDEMAND=DEMAND(3 ) +DEMAND (4 ) +DEMAND ( 5 ) +DEMAND ( 6 ) + 

Si  DEMAND(7) +DEMAND(8) +DEMAND(9) +DEMAND(10) 

TOTAL PROGRAMS PROGRAM ( 3 ) +PROGRAM ( 4 ) +PROGRAM ( 5 ) +PROGRAM ( 6 ) + 
Sc  PROGRAM(7)  +PROGRAM(8)  +  PROGRAM  ( 9  )  +PROGRAM  ( 10  ) 

IF  (TOTALPROGRAM.EQ.O)  THEN 
FORECAST (11) =0.0 
GOTO  30 
ELSE 

OIMDEMANDRATE ( 11 ) =TOTALDEMAND/ TOTAL PROGRAM 
FORECAST  ( 1 1 )  =0  IMDEMANDRATE  (ID*  PROGRAM  (11) 
TOTALCOUNT=TOTALCOUNT+ 1 
ENDIF 
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40 


★  ♦  ★ 

50 


★  ★  ★ 

60 


FORECAST  FOR  PERIOD  12  USING  THE  PREVIOUS  8  QUARTERS 

TOTALDEMAND=DEMAND(4) +DEMAND(5)+DEMAND(6) +DEMAND(7) + 

Sc  DEMAND(8) +DEMAND(9) +DEMAND(10) +DEMAND(11) 

TOTALPROGRAM= PROGRAM ( 4 ) +PROGRAM ( 5 ) +PROGRAM ( 6 ) +PROGRAM ( 7 ) + 

Sc  PROGRAM  ( 8 )  +  PROGRAM  ( 9 )  +  PROGRAM  (10)  +  PROGRAM  (11) 

IF  (TOTAL PROGRAM. EQ.O)  THEN 
FORECAST (12) =0.0 
GOTO  40 
ELSE 

OIMDEMANDRATE ( 12 ) =TOTALDEMAND/ TOTAL PROGRAM 
FORECAST ( 12 ) =OIMDEMANDRATE (12 ) *PROGRAM ( 12 ) 
TOTALCOUNT=TOTALCOUNT+l 
ENDIF 

FORECAST  FOR  PERIOD  13  USING  THE  PREVIOUS  8  QUARTERS 

TOTALDEMAND=DEMAND ( 5 ) +DEMAND ( 6 ) +DEMAND (7 ) +DEMAND ( 8 ) + 

Sc  DEMAND(9) +DEMAND(10)+DEMAND(11)+DEMAND(12) 

TOTALPROGRAM=  PROGRAM ( 5 ) +  PROGRAM ( 6 ) +  PROGRAM ( 7 ) +  PROGRAM ( 8 )  + 

Sc  PROGRAM(9)  +PROGRAM(10)  +PROGRAM(ll)  +PROGRAM(12) 

IF  (TOTALPROGRAM.EQ.O)  THEN 
FORECAST (13) =0.0 
GOTO  50 
ELSE 

OIMDEMANDRATE ( 13 ) =TOTALDEMAND/TOTALPROGRAM 
FORECAST ( 13 ) =OIMDEMANDRATE ( 13 ) *PROGRAM ( 13 ) 
TOTALCOUNT=TOTALCOUNT+ 1 
ENDIF 

FORECAST  FOR  PERIOD  14  USING  THE  PREVIOUS  8  QUARTERS 

TOTALDEMANDaDEMAND ( 6 ) +DEMAND (7 ) +DEMAND ( 8 ) +DEMAND ( 9 ) + 

Sc  DEMAND(10)+DEMAND(11)+DEMAND(12)+DEMAND(13) 

TOTALPROGRAM= PROGRAM ( 6 ) +PROGRAM (7 ) +PROGRAM ( 8 ) +PROGRAM ( 9 ) + 

Sc  PROGRAM  ( 10 )  +PROGRAM  ( 11 )  +PROGRAM  ( 12 )  +PROGRAM  ( 13  ) 

IF  (TOTALPROGRAM.EQ.O)  THEN 
FORECAST (14) =0.0 
GOTO  60 
ELSE 

OIMDEMANDRATE ( 14 ) =TOTALDEMAND/TOTALPROGRAM 
FORECAST ( 14 ) =OIMDEMANDRATE ( 14 ) * PROGRAM ( 14 ) 
TOTALCOUNT=TOTALCOUNT+ 1 
ENDIF 

FORECAST  FOR  PERIOD  15  USING  THE  PREVIOUS  8  QUARTERS 

TOTALDEMAND=DEMAND ( 7 ) +DEMAND ( 8 ) +DEMAND ( 9 ) +DEMAND (10)+ 

Sc  DEMAND(11)+DEMAND(12)+DEMAND(13)+DEMAND(14) 

TOTALPROGRAM=  PROGRAM ( 7 ) +  PROGRAM ( 8 ) +  PROGRAM ( 9 ) +  PROGRAM (10)  + 
Sc  PROGRAM(ll)  +PROGRAM(12)  +PROGRAM(13)  +PROGR.zm(14) 

IF  ( TOTALPROGRAM .EQ.O)  THEN 
FORECAST (15) =0.0 
GOTO  70 
ELSE 

OIMDEMANDRATE ( 15 ) =TOTALDEMAND/TOTALPROGRAM 
FORECAST ( 15 ) =OIMDEMANDRATE ( 15 ) * PROGRAM ( 15 ) 
TOTALCOUNT=TOTALCOUNT+ 1 
ENDIF 
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FORECAST  FOR  PERIOD  16  USING  THE  PREVIOUS  8  QUARTERS 


70  TOTALDEMAND=DEMAND ( 8 ) +DEMAND (9) +DEMAND ( 10 ) +DEMAND ( 11 ) + 

Sc  DEMAND(12) +DEMAND(13) +DEMAND(14) +DEMAND(15) 

TOTALPROGRAM=  PROGRAM ( 8 ) +  PROGRAM ( 9 ) +  PROGRAM (10)+  PROGRAM (11)  + 

Sc  PROGRAM  ( 12 )  +PROGRAM  ( 13  )  +PROGRAM  ( 14  )  +PROGRAM  (15) 

IF  (TOTAL PROGRAM. EQ.O)  THEN 
FORECAST (16) =0.0 
GOTO  80 
ELSE 

OIMDEMANDRATE  ( 16 )  =TOT.za.DEMAND/TOTALPROGRAM 
FORECAST ( 1 6 ) =0 IMDEMANDRATE (16)*  PROGRAM (16) 
TOTALCOUNT=TOTALCOUNT+ 1 
ENDIF 


***  MAD  Sc  MSE 

80  MAD=(ABS( FORECAST (13) -DEMAND (13) ) +ABS (FORECAST ( 14 ) -DEMAND ( 14 ) ) + 
Sc  ABS (FORECAST (15) -DEMAND(15) ) +ABS (FORECAST ( 16 ) -DEMAND(16) ) 

Sc  )/4.0 

MSE=( (FORECAST(13 ) -DEMAND(13) ) **2+ (FORECAST ( 14 ) -DEMAND ( 14 ) ) **2 
Sc  + (FORECAST (15) -DEMAND (15) )* *2+ (FORECAST ( 16 ) -DEMAND (16) ) **2 

Sc  )/4.0 

MADTOT AL  =MADTOT AL  +MAD 
COUNTMAD=COUNTMAD+ 1 

MSETOTAL=MSETOTAL+MSE 
COUNTMSE=COUNTMSE+ 1 

***  MPE  Sc  MAPE 

COUNTERROR=0 

82  IF  (DEMAND (13) .EQ.O)  THEN 
ERROR (13) =0.0 
GOTO  84 
ELSE 

COUNTERROR=COUNTERROR+l . 0 

ERROR ( 13 ) = (DEMAND (13) -FORECAST (13) ) /DEMAND (13 ) 

ENDIF 

84  IF  (DEMAND (14) .EQ.O)  THEN 
ERROR (14) =0 . 0 
GOTO  86 
ELSE 

COUNTERROR=COUNTERROR+l . 0 

ERROR ( 14 ) = (DEMAND (14) -FORECAST (14) ) /DEMAND (14) 

ENDIF 

86  IF  (DEMAND (15) .EQ.O)  THEN 
ERROR (15) =0.0 
GOTO  88 
ELSE 

COUNTERROR=COUNTERROR+l . 0 

ERROR ( 15 ) = (DEMAND ( 15 ) -FORECAST ( 15) ) /DEMAND ( 15 ) 

ENDIF 
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88  IF  (DEMAND ( 16 ) .EQ.O)  THEN 
ERROR(16)=0.0 
GOTO  90 
ELSE 

COUNTERROR=COUNTERROR+l . 0 

ERROR ( 16 )= (DEMAND (16) -FORECAST (16) ) /DEMAND l 16) 

ENDIF 

90  IF  ( COUNTERROR. EQ. (0.0) )  THEN 
MPE=0.0 
MAPE=0 . 0 
GOTO  95 
ENDIF 

WRITE(*, 5000)  1 

MPE=( (ERROR(13)+ERROR(14)+ERROR(15)+ERROR(16) ) /COUNTERROR) *100.0 
MAPE=( (ABS (ERROR (13) ) +ABS (ERROR (14) ) +ABS (ERROR ( 15 ) ) +ABS (ERROR ( 16 ) 
Sc  )) /COUNTERROR)  *100.0 

MAPETOTAL=MAPETOTAL+MAPE 
COUNTMAPE=COUNTMAPE+ 1 
MPETOTAL=MPETOTAL+MPE 
COUNTMPE=COUNTMPE+ 1 

**  WRITING  OUTPUT  FILE.  IT  INCLUDES  THE  FORECASTS  AND  FORECASTING  ** 

**  ERRORS  ** 

95  WRITE(2,3000)  • 01 NSN, DEMAND (13 ) , 

Sc  DEMAND  ( 14 )  .DEMAND  (15)  ,  DEMAND  (16) 

WRITE(2,3000)  ' 02 ' , NSN, FORECAST ( 13 ) , 

&  FORECAST ( 14 ) , FORECAST ( 15 ) , FORECAST (16) 

READ  (NSN,  8000)  NUN 

WRITE (2, 4000)  • 03 ' ,NIIN,MAD,  MSE,  MPE,  MAFE 

100  WRITE (*,5000)  COUNT 
ENDDO 

110  PRINT,  MADTOTAL/COUNTMAD 
PRINT,  MSETOTAL/COUNTMSE 
PRINT,  MPETOTAL/COUNTMPE 
PRINT,  MAPETOTAL/COUNTMAPE 

CLOSE ( 1 ) 

CLOSE (2) 

END 
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Appendix  D:  Data  Elements  for  SDF  and  RDB 

Record  #1  -  Data  Information 


Comment 

Data  Type 

1-2 

2 

Air  Logistic  Center 

3-4 

2 

NSN 

5-19 

15 

Blank 

20-22 

3 

Item  Name 

23-32 

10 

Blank 

33-34 

2 

Cost 

35-41 

7 

Dollar  Value  =  integer 

Blank 

42-43 

2 

Consumable/Reparable  Code 

44-44 

1 

All  items  are  reparable  =  R 

Blank 

45-46 

2 

Previous  Demand  Average 

47-53 

7 

Determined  by  Navy 

Blank 

54-55 

2 

Previous  Demand  Variance 

56-62 

7 

Determined  by  Navy 

Blank 

63-64 

2 

Previous  Demand  Forecast 

65-71 

7 

Determined  by  Navy 

Blank 

72-73 

2 

Previous  Demand  Leadtime 

74-80 

7 

Determined  by  Navy 
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Appendix  E:  Aircraft  Sustainability  Data  Values 


LRU  COMPONENT  DATA  FILE  -  orefx.  1 

Each  line  replaceable  unit  (LRU)  component  will  have  a  corresponding  series  of 
seven  records  in  this  file.  These  are  read  as  FORTRAN  free-format  records  with  fields 
separated  by  a  blank  space  and  column  positioning  is  insignificant. 


Record  No.  1 


NSN 

COST 

IQPA 

FAP 


PLTT 

ITASSE 


NHANSN 


ffiUDCODE  = 


National  stock  number  of  the  component. 

Unit  cost. 

Quantity  installed  per  aircraft.  Assumed  that  all  items  had  a  IQPA 
of  one. 

Future  application  fraction:  the  fraction  of  aircraft  that  will  be 
configured  with  this  NSN.  Assumed  that  all  items  had  a  FAP  of 
100%. 

Procurement  lead-time  in  months.  Assumed  that  all  items  had  a 
PLTT  of  zero.  As  soon  as  we  buy  the  item,  we  get  the  item. 

The  starting  asset  position  for  the  NSN  before  any  buys  are  made 
by  the  Aircraft  Sustainability  Model  (ASM).  Assumed  that  all 
items  had  a  ITASSE  of  0. 

NSN  of  the  next  higher  assembly  (NHA);  the  next  higher  assembly 
for  LRUs  will  be  the  weapon  system,  in  this  case  FCAl  (Fictitious 
Canadian  Aircraft  One). 

A  budget  code  integer  from  1  to  9  that  permits  cost  subtotals  to  be 
generated  by  budget  code.  Currently,  a  value  of  1  denotes  an  LRU 


E-1 


NEGLV 


MAINTCON  = 


ITEMPBUY  = 


CANNFLAG  = 


NOPFLAG  = 


NRTSDEC  = 


with  shop  replaceable  units  (SRUs)  and  2  denotes  an  LRU  without 
SRUs.  Assumed  that  ail  items  had  a  value  of  two. 

Negotiated  level  for  this  NSN.  Sometimes,  requirements  levels  are 
set  without  regard  for  optimization.  If  NEGFLAG  [in  the 
parameters  (P ARAMS)  file]  is  set  to  true,  the  model  will  buy  up 
from  ITASSE  to  NEGLV  sacrosanct.  Assumed  that  all  items  had 
a  value  of  zero. 

Specifies  whether  the  LRU  is  remove  and  replace  (RR)  or  remove, 
repair,  and  replace  (RRR).  This  affects  when  (if  ever)  wartime 
LRU  base  repair  begins.  Assumed  that  all  items  had  a  value  of 
RRR. 

Fraction  of  the  pipeline  to  be  bought  sacrosanct  for  this 
component.  This  value  is  used  only  if  the  PBUYA  field  on  the 
PARAMS  file  is  coded  "ITEM".  Assumed  that  all  items  had  a 
value  of  0.00. 

A  value  of  "N"  indicates  this  item  may  not  be  cannibalized,  a  value 
of "  Y"  indicates  that  it  can.  This  value  is  only  used  if  the  CANN 
field  of  the  PARAMS  file  is  coded  "P"  for  partial  cannibalization. 
Assumed  that  all  items  had  a  value  of  N. 

Applicable  only  to  data  drawn  from  the  Air  Force's  WRSK/BLSS. 
A  value  of  "NOP"  indicates  that  the  item  is  non-optimized 
(NOPed).  However,  NOPed  items  are  still  a  factor  in  constrained 
budget  analysis.  Processing  of  NOPed  items  is  currently  being 
developed.  Assumed  that  all  items  had  a  value  of  AAA. 

Decision  to  ship  this  component  to  the  next  higher  servicing 
facility  is  made  before  attempting  repair  ( 1)  or  after  repair  (0). 
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Assumed  that  all  items  had  a  value  of  one. 


Record  No.  2 
IBRTP 

BRTW 


Record  No.  3 
lOSTP 

lOSTW 


Record  No.  4 
IDRTP 

IDRTW 

Record  No.  5 
TOIMDRP  = 
TOIMDRW  = 

Record  No.  6 
BNRTSP 


Peacetime  base  repair  time  in  days  for  this  component.  Assumed 
that  all  items  had  a  value  of  four. 

Wartime  base  repair  time  in  days  for  this  component.  Assumed 
that  all  items  had  a  value  of  four. 


Peacetime  order  and  ship  time  in  days  for  this  component. 
Assumed  that  all  items  had  a  value  of  17. 

Wartime  order  and  ship  time  in  days  for  this  component.  Assumed 
that  all  items  had  a  value  of  17. 


Peacetime  depot  repair  time  in  days  for  this  component.  Assumed 
that  all  items  had  a  value  of  30. 

Wartime  depot  repair  in  days  for  this  component.  Assumed  that 
all  items  had  a  value  of  30. 

Peacetime  demand  per  flying  hour  for  this  component. 

Wartime  demand  per  flying  hour  for  this  component. 


Base  not  reparable  this  station  rate  -  peacetime  percentage  of 
demands  that  are  either  condemned  or  sent  to  the  depot  for  repair 
(overhaul)  for  this  component.  Assumed  that  all  items  had  a  value 
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of  40%. 


BNRTSW 


Record  No.  7 
CONPCTP  = 

CONPCTW  = 


Base  not  reparable  this  station  rate  -  wartime  percentage  of 
demands  that  are  either  condemned  or  sent  to  the  depot  for  repair 
(overhaul)  for  this  component.  Assumed  that  all  items  had  a  value 
of  40%. 

Peacetime  condemnation  fraction  for  this  component.  Assumed 
that  all  items  had  a  value  of  1%. 

Wartime  condemnation  fraction  for  this  component.  Assumed  that 
all  items  had  a  value  of  1% 


SRU  COMPONENT  DATA  FILE  -  prefx.  2 

No  SRU  file  was  used  since  items  were  considered  as  LRUs. 


EARAMETEESFILE..  prsfx,PRM 

The  parameters  file  contains  all  the  processing  options  for  a  particular  ASM  run 
such  as  the  weapon  system  name,  the  flying  program  for  the  scenario,  the  day  to  be 
analyzed,  the  direct  support  objective  (DSO),  the  first  day  that  base  repair  of  LRUs  is 
permitted,  and  the  type  of  computer  on  which  the  model  run  is  being  made  (PC  for 
personal  computer,  or  HON  for  Honeywell).  The  ddd  in  the  file  name  is  the  day(s)  in  the 
days  of  analysis  card.  The  parameters  in  each  file  are  determined  on  the  ENMCS 
objectives  on  the  Option  25  card. 

These  are  read  as  FORTRAN  free-format  records.  In  this  file,  each  field  must  be 
on  a  separate  line. 

rrODAY  =  The  day  to  be  analyzed.  Must  be  between  0  and  99.  Took  the 
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value  of  zero. 


DATADIR  = 

OUTPDIR  = 

DEBUGER  = 

PIPEFLAG  = 

CANN 

NSNFILE 

NEGFLAG  = 

EXPRESUP  = 


The  drive/directory  that  contains  the  ASM  input  data.  For 
example,  C:\ASM\DATA  or  \ASM\F1 1 IDATAV  Note  the  trailing 
backslash  (\)  that  is  required. 

The  drive/directory  that  contains  the  ASM  output.  For  example, 
\ASM\OUTPUT\Flll\. 

Specifies  the  extent  to  which  debug  output  should  be  printed. 

Must  be  FULL,  SOME,  NONE,  or  NSNS;  defaults  to  NONE. 
Specifies  whether  the  computed  pipeline  quantities  will  be  written 
to  the  OUTPIPE  file.  Must  be  T  or  F;  defaults  to  T. 

Specifies  the  type  of  cannibalization  allowed.  A  value  of  "F" 
means  all  items,  a  value  of  "N"  means  no  items,  and  a  value  of  "P" 
means  those  items  coded  "Y"  in  the  CANNFLAG  of  the 
component  data  files  may  be  cannibalized.  Took  the  value  of  N. 
If  DEBUGER  is  set  to  NSNS,  it  specifies  the  file  where  a  list  of 
NSNS  is  stored.  This  file  must  be  in  the  DATADIR  directory  and 
must  contain  one  NSN  per  record.  The  ASM  will  then  print  debug 
output  for  each  NSN  in  that  list. 

Specifies  whether  the  model  is  to  treat  NEGLV  as  a  sacrosanct 
level.  Must  be  T  or  F.  T  indicates  purchase  of  NEGLV  quantity  as 
a  floor.  Took  the  value  of  F. 

Specifies  that  resupply  is  exponential  rather  than  deterministic. 
Must  be  T  for  exponential  or  F  for  deterministic.  Took  the  value 
ofF. 
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OPTMTHD 


BUYPEAK  = 

COMPUTER  = 

VMOPTION  = 

Q 

PBUYA 


WSNAME  = 


A  value  of  C  indicates  confidence-level  optimization;  a  value  of  E 
indicates  ENMCs  optimization;  a  value  of  M  indicates  the  interim 
(ENMCS/EBOs  optimization)  method.  Took  the  value  of  E. 
Specifies  whether  the  peak  pipelines  for  the  whole  scenario  (T). 
the  peak  pipe  pipelines  through  a  specified  day  (for  example,  30), 
or  the  pipelines  on  the  day  to  be  analyzed  (F)  are  to  be  bought 
sacrosanct  to  the  level  specified  by  PBUY  (see  below).  Took  the 
value  of  T. 

Identifies  host  computer  for  the  ASM.  Should  be  set  to  "PC"  for 
any  microcomputer.  Took  the  value  of  PC. 

Specifies  how  the  variance-to-mean  ratio  (VMR)  computation  is  to 
be  performed.  May  be  1,2,  3,  or  4  but  anything  greater  than  1 
(fixed  VMR)  is  highly  experimental.  Took  the  value  of  one. 

For  VMOPTION=i,  specifies  the  constant  VMR.  Must  be  at  least 
1.0.  Took  the  value  of  1.5. 

Specifies  the  percentage  of  the  pipeline  to  be  bought  sacrosanct; 
either  peak  or  for  ITODA Y,  see  BUYPEAK.  A  value  of  1 .0 
would  .specify  buy  the  whole  pipeline,  0.5  would  buy  half.  0.0 
would  buy  none.  PBUYA  consists  of  two  numbers:  the  first  is  the 
value  for  LRUs,  the  second  for  SRUs.  A  value  of  "ITEM"  may 
also  be  used  to  indicate  that  the  percentage  coded  in  ITEMPBUY 
on  the  component  data  files  will  be  bought  sacrosanct.  A  value  of 
"QPA"  overrides  the  ITEMPBUY  field  and  buys  the  floor  quantity 
for  items  with  QPA  >  2.  Took  the  value  of  0.0. 

Weapon  system  name  (e.g..  Fill,  F004,  etc.).  Took  the  value  of 
FCAl. 
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NUNTTS 


Number  of  units  of  the  weapon  system  at  each  base  (PAA).  Took 
the  value  of  24. 

NBASES  =  Number  of  bases.  Took  the  value  of  one, 

NFIRSTBR  =  The  first  day  base  repair  is  allowed.  Base  component  repair  is 

suspended  for  days  1  through  NFIRSTBR- 1.  NFIRSTBR  is  an 
array  of  three  numbers:  NFIRSTBR(l)  is  the  first  day  that  RR 
LRUs  are  repaired,  NFIRSTBR(2)  is  the  first  day  that  RRR  LRUs 
are  repaired,  NFIRSTBR(3)  is  the  first  day  that  SRUs  are  repaired. 
Took  the  value  of  one. 

NFIRSTDR  =  The  first  day  depot  repair  is  allowed.  Depot  component  repair  is 
suspended  for  days  1  through  NFIRSTDR- 1.  NFIRSTDR  is  an 
array  of  three  numbers;  NFIRSTDR(l)  is  the  first  day  that  RR 
LRUs  are  repaired,  NFIRSTDR(2)  is  the  first  day  that  RRR  LRUs 
are  repaired,  NFIRS7T>R(3)  is  the  first  day  that  SRUs  are  repaired. 
Took  the  value  of  one. 

NFIRSTOS  =  The  first  day  that  .shipment  from  the  depot  becomes  available. 

Took  the  value  of  one. 

DSO  =  The  number  of  not  mission  capable  for  supply  (NMCS)  aircraft 

allowed.  The  model  optimizes  the  probability  that  the  number 
NMCS  is  not  greater  than  the  DSO.  Took  the  value  of  7.2. 

FNAME  =  The  name  (without  extension)  of  the  files  containing  the  LRU  and 

SRU  component  data. 

NDAYS  =  The  last  day  for  which  the  component  data  will  change.  The 

component  data  is  specified  for  day  0  through  day  NDAYS  (in  the 
COMPDATA  file).  The  component  data  on  days  before  day  0  are 
assumed  identical  to  day  0.  The  component  data  on  days  after  day 
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NDAYSFH  are  assumed  to  be  identical  to  day  NDAYSFH.  For 
now,  NDAYS  is  set  to  1  --  i.e.,  resupply  times,  failure  rates  -  are 
assumed  to  be  constant  for  each  day  of  the  war.  Took  the  value 
of  zero. 

NDAYWARN=  The  number  of  days  warning  before  the  start  of  the  scenario 
(normally  set  to  0).  Allows  the  resupply  times  to  shift  to  the 
wartime  values  before  the  start  of  the  scenario.  Took  the  value  of 
zero. 

COMMENT  =  Up  to  60  characters  of  notes.  This  is  a  separate  record  in  the  file 
and  may  contain  blanks. 

SCENARIO  FILE -orefx^C 

The  scenario  file  contains  specific  items  about  the  flying-hour  program  for  an 

ASM  run.  These  are  read  as  FORTRAN  free-format  records. 

NDAYSFH  =  The  last  day  for  which  the  flying  program  will  change.  The  flying 

program  is  specified  for  day  0  through  day  NDAYSFH.  (See  the 
next  field,  FHP.)  The  flying  programs  on  days  before  day  0  are 
assumed  identical  to  day  0.  The  flying  programs  on  days  after  day 
NDAYSFH  are  assumed  to  be  identical  to  day  NDAYSFH.  T(»)k 
the  value  of  zero. 

FHP  =  The  array  of  the  flying-hour  program  in  hours  per  day,  for  days  0 

through  NDAYSFH.  Took  the  value  of  10. 
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TRBID  -  %  AVAILAUf  AIRCRAFT 

ROB 

SOF 

QUAsmn  J 

74.30% 

75.08% 

QUARTER  2 

74.27% 

74.98% 

QUARTERN 

74.10% 

74.95% 

QUARTER  4 

74.12% 

74.90% 

t'Twt:  P(Rr«d  Two>Sampl*  tai  Meant 

Variable  1 

Variable  2 

Mean 

0.7420 

0.7498 

Variance 

1.06E-06 

5.86E-07 

Observations 

4.0000 

4.0000 

Pearson  Correlation 

0.8216 

Pooled  Variance 

0.0000 

Hypothesized  Mean  Ditterencf 

0.0000 

dt 

3.0000 

t 

-26.6226 

t  Critical  two-tall -9CJ% 

3.1824 

t  Critical  one-tall  -  95% 

3.1824 

SEASONAL  -  %  AVAlUBtE  AIRCRAFT 

ROB 

SOF 

QUARTER  1 

78.93% 

80.93% 

QUARTER  2 

78.71% 

79.13% 

QUARTER  3 

78.92% 

78.97% 

QUARTER  4 

78.90% 

80.31% 

t-Tetl;  Paired  Two-Sample  lot  Meant 

Variable  I 

Variable  2 

Mean 

0.7887 

0.7983 

Variance 

1.05E-06 

8.84E-05 

Observatlors 

4.0000 

4.0000 

Pearson  Correlation 

0.5339 

Pooled  Variance 

0.0000 

Hypothesized  Mean  Difference 

0.0000 

dt 

3.0000 

t 

-2.1723 

t  Critical  two-tall -90% 

3.1824 

t  Critical  one-tall  -  95% 

3.1824 

CVCUCAL  •  %  AVAILABLE  AIRCRAFT 

ROB 

SDF 

QUARTER  ; 

86.96% 

87.25% 

QUARTER  2 

86.63% 

86.57% 

QUARTER  3 

86.64% 

87.23% 

QUARTER  4 

86.90% 

86.83% 

l-Tetl:  Poked  Two-Sample  for  Meant 

Variable  1 

Variable  2 

Mean 

0.8679 

0.8697 

Variance 

3.06E-06 

l.nE-05 

Observations 

4.0000 

4.0000 

Pearson  Correlation 

0.3547 

Pooled  Variance 

0.0000 

Hypothesized  Mean  Difference 

0.0000 

dt 

3.0000 

t 

-1.1481 

t  Critical  two-tail -90% 

3.1824 

t  Critical  one-tall  -  95% 

3.1824 

OUTUEK  •  %  AVAILABLE  AIRCRAFT 

RDB 

SDF 

QUARTER  ? 

83.25% 

84.05% 

QUARTER  2 

82.99% 

83.97% 

QUARTER  3 

83.15% 

83.98% 

QUARTER  4 

82.85% 

84.04% 

t-Tect:  Palled  Two-Sample  lor  Meant 

Variable  1 

Variable  2 

Mean 

0.8306 

0.8401 

Variance 

3.08E-06 

1 ,47E-07 

Observations 

4.0000 

4,0000 

Pearson  Correlation 

0.0159 

Pooled  Variance 

0.0000 

Hypothesized  Mean  Difference 

0.0000 

df 

3.0000 

t 

-10.6221 

t  Critical  two-tail  -90% 

3.1824 

t  Critical  one-tail  -  95% 

3.1824 
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I RANDOM  -  X  AVAILAUE  AIRCRAFT 


REAL  DATA  -  X  AVAUABU  AIRCRAFT 


RDR 

SDF 

QUAmR  1 

91.88X 

90.63% 

QUARTER  2 

68.36X 

90.55% 

QUARTBRi 

91,00% 

90.45% 

QUAR7SR4 

90.77% 

90.51% 

MmI:  Pdr«dTwo-$ampl#lor  MMni 

Variable  1 

Variables 

Mean 

0.9050 

0.9054 

Variance 

2.27E-04 

5.63E-07 

Obseivations 

4.0000 

4.0000 

Peanon  Correlation 

0.1171 

Pooled  Variance 

0.0000 

Hypothesized  Mean  Oifferencs 

0.0000 

df 

3.0000 

t 

-0.0449 

t  Critical  two-tail  -90% 

3.1824 

t  Critical  one-tail  -  95% 

3.1824 

RDR 

SDF 

QUARHR  ? 

79.84% 

70.73% 

QUARTERS 

80.28% 

80.50% 

QUARTER  3 

00,36% 

80.66% 

QUARTER  4 

80.59% 

80.33% 

l-Ted:  P(*ed  Two-Sample  to  Meant 

Variable  1 

Variable  2 

Mean 

0.8027 

0.8006 

Variance 

9.96E-06 

798E-05 

ObservarioTB 

4.0000 

4.0000 

Pearson  Correlation 

0.8514 

Pooled  Variance 

0.0000 

Hypothesized  Mean  Difference 

0.0000 

df 

3.0000 

f 

0.6514 

t  Critical  two-tail -90% 

3.1824 

t  Critical  one-tail  -  95% 

3.1824 
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